Confusing Libra man

Hi everyone, having a hard time understanding this Libra man. Idk if it's my Virgo overthinking and over analyzing everything but we recently met in December we hit it off and slept together (huge mistake I know) I didn't think much of it at all we texted after sleeping together but I left him on read the day I was going to see him (no mind games he just replied dry so I thought convo over) he then brought it up to me jokingly around "oh wow haha you left me on read" he then went back to the state he lives in. We text all the time 24/7 and Facetime once a week he has even invited me to visit him and offered we split the ticket. We recently went to Chicago together with a group of friends and stayed together alone in a room. We had a great time, we acted like a couple but not really he would hold my hand and kiss me but at times would leave me behind. Not that it was something I minded I know Libra men appreciate their time with their friends a lot. Now after the trip I am realizing how much I like him and I dont want to get hurt but I feel it's way too soon to even bring up what are we. In July, he's moving closer to me. What do you guys think? Just go w the flow or distance myself? I know if I distance myself he's not going to look back twice.