and yet you got back together with him?
in all seriousness: STAND UP FOR YOURSELF.
If you need to, talk to your friends/family/parents first about it to head off any mis-truths he may be about to spread. But you can't let him emotionally blackmail you and expect a happy, enjoyable relationship out of it