Move the hell on. He is unhealthy on many levels and toxic to you. How many times as he disrespected you, lied to you, and not bern there when you needed him. His life style is more important then you and his kids. Run and thank God you were able to catch him before you invested more time and energy into a person like that.
Break the cycle by saying no and most importantly, start questioning yourself as to why you allowed and tolerated this guy this much, in the first place. Otherwise you risk deal with this again with someone else.