There's nothing more you can do, you explained and apologized... you have to ride this out and let him come to you.
Does this Cancer man want more than a friendship? I'm confused...
If that's the case, not really sure if you can just go back to being friends. It will take some time.