People dont belong in your space unless you invite them...do you want him in your space??? (personal space) Keep your hands away from his so he cant touch them put them behind your back if you have to! He has no boundries with you because you haven't set them, so stop being sweet yourself and set those boundries. You've made this harder for yourself by allowing him to cross those lines in the first place!
I've learnt, Sometimes we have to stop being sweet because people of all walks take advantage of it!