Sagittarius Man Playing Games

Please help! Need Advice!

So I been talking to this Sagittarius guy for almost 8 months but it's very complicated. We aren't together in a relationship because we started out as friends and I met him through my brothers. He is very close with them and because of that when we started hooking up we kept it a secret. In the beginning he use to sneak and come over my house almost every night and texting me every night. But as the weeks went on my feelings started to get more serious and I wanted more. I asked him did he feel the same and he said yes but he said how are we suppose to do this with him being cool with my brothers? Then he said he doesn't wanna hurt me🤔🤷🏽‍♀️ So I decided to continue how things already was....a secret. But after a while of course my brothers found out. And it wasn't a big deal surprisingly. But still I would only have contact with him at night😩 It started to get more annoying because he would only text me after 9 and only coming over past 1 in the morning most of the time. Out of the whole 8 months I think he only called my phone once during the day on regular hours and facetimed me once and texted me four times. This caused me to also not call or text him during regular hours only at night because when I would try it's like he takes FOREVER to text back! I finally had another talk with him and told him I'm ready for something serious, like am I just a bootycall? And he said no you aren't. I love you and you mean a lot to me. I said then why do I only hear and see you late hours?? He said I wouldn't understand. After a few months he stopped texting me every night and he stopped coming over every night. Now I only hear from him 2 or maybe 3 times out of the week and it's still at night!!! He doesn't have a girlfriend but he does talk to a few females but the reason I never got to upset about it is because we aren't together even tho I would like too. Plus when he comes over I try to have conversations with him about personal things but he doesn't open up to me enough. He told me some things about his past but he doesn't really talk to me. It's like he comes over and we laugh and joke about some stuff but then it quickly leads to sex and then he falls asleep and then he's gone and I don't hear from him in days. But when I ask him he says I'm his and he doesn't want me talking to no other dudes. He confuses me soooo much but I like him so much. Please help