Sometimes people come into your lives just to teach you about yourself. He's moving away from you even farther, so it really wasn't meant to be. Aren't you glad it never really got off the ground? There was already some distance between you and now there's even more.
Hopefully you meet someone else that makes you feel the way he did. I know how hard it is to move on.