confused help this sag

I've been dating this cappy for almost 4 months now, it started out very casual, but now I have feelings. I'm pretty sure he feel the same now but aren't 100% sure. We were both out of town recently visiting friends and he txt me the entire way to make sure I made it there ok and txt me while I was there just to chit chat. I have yet to meet any of his friends and vice versa with me. I feel like he should invite me first. But anyway while I was away he actually said he kinda missed my company that was a first then he mentioned something about meeting my brother well he actually said " well when I meet him" I gave him a puzzled looked because he never mentioned anything like this before. He has been so busy with work that he thought I was upset with me and I told him that, that one thing I totally understand which I so its not an issue. I'm just a bit confused bc I'm really starting to care about him but don't know how to express that and not scare him. help please