Help needed... Scorp x Virgo

So, I've been kind of "dating" this Scorpio man (I'm a Virgo woman) for almost three years now. Sad thing is, we had only a few moments together because until just a few months ago, we were in a position that did not allow us to date. Still, we had one date almost a year ago and a few private conversations. Other than that, we were/are texting a lot.

It started with him making the first moves, making it super obvious that he likes me. Eventually, he texted me first and I fell for his intellect, romantic behaviour and stunning appearance. He was so cute and flirty at first, but only after a few weeks, he turned to be distant. And I realized, that he was either very busy or very in love (according to the internet).

After all, we were digitally fantasizing about what could be, what we wanted to do and stuff...I quickly learned to be open to his naturally wild side (bedroom stuff). Looking back, it was not a good idea to do so, cause we were in no position to live those dreams which was frustrating for both of us.

Some time passed and then... I felt the whole power of Scorpio's passion and contradiction. It started with him saying he doesn't know how he feels about me, I give him time to think, he comes back saying he wants to be with me. Then again, he wants to stop texting for a while, months pass and he comes back more in love than ever.

Now, we are finally able to be together, to sort things out and learn to love each other in real life, not just per chat. But suddenly, he doesn't want that. He told me he "has neither the time nor the nerves for a date in the next few weeks". A few days later, we flirt again and he wants to plan a date, next day, I ask about time and place and *poof* he's mad about me for asking cause he clearly said he doesn't want to.

Right now, I am so confused and hurt. How does he imagine a relationship to work? It really hurts me that he fools me like this, giving me hope then letting me down. I really don't know what to do with him. I told him that we should probably not text for a few weeks cause I learned it's wise to give him space and silence when he's mad. To me, it seems like he does not at all know what he wants.

I really need some advice and analyzation from a more advanced person than myself ? Cause I do love him and I know he feels deeply for me too, but I just have no clue how to solve this and makes this a happy, stable relationship.

Happy about every single answer or advice ??