Help me understand him!! (Sag guy)

 don't know what to do now well i sort of no what to do but not sure if it's what i want to do anywho Started off good but dating/being him brought a lot of drama with him. We never argue, i can come to him and talk to him about anything that is bothering me, i don't nag him but going through issues with Crazy ex gf, him sleeping with other women, going back and forth to jail, people in my ear telling me about things he's been up to, now we have a baby together! I've been through so much with him in a short time and i still try to stick with him through it all, trying hard to ignore all of the outside bs. He's still in jail but has become extremely distant but wants me to write and send pics with nothing in return from him no phone calls no letter nothing.i think/know he's back in his ex gf face sweet talking her and now being distant with me. Knowing this it just makes me want to distance myself from him permanently but it's hard because we have a baby together. He feels as though we have a baby together that ties me to him permanently as if it's his hold on me he told me that no matter what the situation may look like i'm not going anywhere and at the end of the day i will Always be around (whatever that means). He said that to me a while back and now He's just been extremely distant and He's not good at communicating at all! I just recently wrote him telling him how i feel about everything.... Really don't know what else to do now... It's crazy because i went through something similar with my ex bf who is also a sag guy but he's older. My ex cheated on me then dropped me for another girl but wanted to keep me around making promises to marry in the future and telling me "you never know what will happen in the future" to keep me hanging on to him. When i finally got the guts to do my own thing and start dating other people and stop hanging onto him he acted as if he were ready to commit and then would guilt me for officially moving on. And he was still technically with the girl he cheated on me with but he would always say "everything is not what it's cracked up to be" i took it as him being lowkey miserable with the chick he cheated on me with but for some reason he didn't want to break up with her. Anywho fast forward this chick f's him over they're not together but still friends and now He's in my face telling me im his soulmate, im perfect for him, my loyalty is like no other, I've never tried to hurt him or take revenge despite all that he's done to me. Thing is i don't want him because I've tried and endured waiting on him for 2 years and nothing changed. But anywho after him i met the current sag (younger) guy and they're similar but also different. It just seems like deja vu. 

He comes off as shy and a little quiet but he's not, and he can also be sweet caring and helpful. It's just him seeing different women and me wondering where i stand in all of this i feel as if he's seeking to replace me or isn't satisfied with only me... —

Anywho 

My sun is cancer, aries moon, cancer rising, mercury-jupiter all leo, saturn aquarius, uranus-neptune capricorn, pluto scorpio

Sag (sons dad) sun sag, moon virgo, rising pisces, mercury scorpio, venus mars sagittarius, jupiter scorpio, saturn aquarius, uranus-neptune capricorn, pluto scorpio