First intense convo, then disappearing act...help?

Hi :-). I'm in the thick midst of my first personal experience with my cancer man's nature. Here's a quick run down of our situation... We've been very casual acquaintances for about 3-4 years. I never had an interest in him other than friendship so every time we talked (usually online because we live far from each other) we kept it very light in conversation. He was usually the one to initiate contact and we always had great dialogue. Last year we started communicating more often. I have family in his state so one day I was there visiting family and I sent him a msg to see if he wanted to get together. He came and took me out right away, and the next day. It was very casual but we had a great time. From that day (over 6 months ago), he's called me every day, numerous times a day. So I started to develop strong feelings for him, and even through his 'indirectness' I felt he was developing them for me. He invited me on a weekend away with him last month. We had an amazing time together. He was sooooo affectionate and loving and just the sweetest person in the world to me! He did things he told me he does not do regularly (like hold hands walking down the street). We got intimate, and even that was so special and sweet. After that, I came back home and we kept the regular pattern of daily phone calls, skype video chats, etc. He told me he needs to see me again because that weekend wasn't enough time with me and I agreed. Our conversations have continued to be wonderful, but with a very 'general' feel to them. He doesn't ever talk about 'us'. I initiated an 'us' conversation 2 days ago and it didn't turn out very well. The whole time he was trying to make me say how I was feeling for him without him making any effort to say anything. He told me I'm afraid of putting myself 'out there' because I'm afraid he won't feel the same way. We went back and forth with this annoying general pattern and I felt like he was starting to feel very pressured. I, myself, was very annoyed. It was late, he had to work in the morning, he got off the phone. 5 minutes later he called me back and said he felt I had something to say. That convo lasted 15 mins and we got off the phone again, with not much accomplished. I didn't hear from him yesterday at all, I sent him a msg last night just saying 'i'm thinking of you' and he didn't respond. I'm frustrated. Don't know what to do. Please shed some light on this for me. I sincerely appreciate it!!!!