Leo: what the heck is he talking about?

I reconnected with a leo male after 26 years (2 marriages for him, one for me) and we have been seeing each other for the last 3 months. He is a single father and his daughter just had a baby, both live with him. The baby daddy is a complete waste. He has introduced me to his Mom, and his siblings. When we first started seeing each other, he wanted me to move in and help share the burden....but when I started returning those feelings he did the famous leo hot/cold thing. So he disappeared. Being a Libra female, I am always looking for a cause, a joint venture, a partnership. I have made myself available to him and his daughter, I have loaned money, I have taken care of the baby. He only seems to like to have me over on weekends. This past friday, I went over and his daughter was out, pretty much as soon as I walked in he had pounced on me and it got really hot really fast. His daughter came home so we had to stop before we could "finish". When I went over on Saturday, I brought food for them and we all 3 had a good time. His daughter decided to go shopping and asked me to watch her son. We were all teasing and she said she did not want her Dad to have sex anywhere in the house, I asked how about my car and she said no because she rides in there. I told her, I'm an adult and I do have needs she suggested I get a blanket and go in the backyard. After she left I was rocking the baby and I told her Dad that that comment hurt my feelings........OMG he went off on me like noone has ever before. For 10 minutes he told me how ultrasensitive I am, how I let what a 19 year old said bother me, how he can not take the stress of walking around on pins and needles, how he is not going to have sex with me with his daughter in the next room. He said I have to decide rather I am ok with seeing him when we cant have sex or only when we can. **disclaimer**I recently had surgery that prevents intercourse until I get the all clear from the surgeon. I tried to explain it was what he didnt say that upset me not what she said. She called while he was fussing at me, and he told her that she had upset me and that he was an adult. He asked me to not say anything to her about it as it would upset her. After she came home she had a bad experience with the baby daddy and she was upset and crying. Her Dad held her while she cried. I listened and after an hour or two, she calmed down and everything went back to normal.

He asked if I was still planning on dinner the next day at his moms, and I said If he still wanted me to go. We went and had a great time. After we got back to his house, I told them I needed to go. Both asked me to please stay so I did but I was still hurt from the night before so I told him while we were sitting on the deck that in light of the tension from the night before I felt it would be best If I started seeing other people. He said "for sex?" I couldnt believe it, I said You know I cant have sex right? He said that was fine because he didnt really have time for me anyway. I got my crap together and left, he kissed me goodbye and I felt like he wanted to say something but i dont know what. He told me on the phone that he will call me when he has free time so we can "hook up". Thats where we left it, I dated someone else but they arent who I want to be with. We have never said I love you, only that we care deeply for each other. Should I not date other ppl, and just hang out with friends (male and female)? Or wait this out?