put yourself in his shoes. if some dude did that to you and drove past place and saw your car parked out there and then had the nerve to text you about it and accuse you of cheating, i dont think you would respond either. i know for a fact i wouldnt talk to him for a long time. wait a while