If you don’t want to lose him give him what he wants.
If you don’t want to lose yourself and your self respect, you set boundaries and hold your ground as you have done.
Trust me when I say that any other path than what you have already taken would only sour the relationship and could wind up in a sorrow deeper than you could ever realize.