How to let a Virgo man know that you like him?

I've been seeing a Virguy regularly for most of this year. We talk almost every day and try to see each other in person about once a week.

The chemistry between us is palpable, and he's told me he likes me. However nothing ever really develops. Every time it gets close to developing, one of us gets scared and backs away. Not because we're scared of moving forward (at least not on my part), but because we're scared that the other doesn't feel the same.

In the early days of learning about each other we both spoke about our exes, and he implied he wasn't ready for a new relationship yet. Maybe I attributed more significance to the way he implied it than was actually necessary, but the knowledge of that has had me holding back from him for the last 6 months or more.

I'd really like to take it further with him, and I think he wants the same, but I'm not sure how to broach the subject with him. I'm terrified of rejection because he means an awful lot to me (which is ironically pretty much how I think he feels also... but my lack of surety on that issue is making me freeze over...)

So my question is: how do I tell him that I like him, enough that he gets a clear picture, but without being so undiplomatic as to say it outright? How do I let him know that I want to take it further with him?

He's a 10th house Virgo sun, with an 8th house moon in Leo, 9th house Venus in Virgo and a 10th house Libra Mars.

I'm a 6th House Scorpio Sun, 11th house Taurus moon, 7th house Sagittarius venus and 2nd house Cancer mars.

Slowly start doing more, inviting him more, spending the night....

Basically start spending more time with him. He’ll get the point. Then just tell him. We like straight forward