He thinks i’m scared to admit to myself that I need to let him go and move on.

Do you want us to reassure you that it is OK to let him go and move on?
It seems you are afraid to take responsibility for your own decision.
This is something that I struggle with too. Taking responsibility for big decisions. I am afraid of the ensuing guilt of making the wrong one. As I look at your situation, it seems much clearer to me. (as it is easier to see others’ best course of action than our own 🙂 )
My gut feeling is let him go of course and your boyfriend is right. He might be using reverse psychology with you , which is kind of manipulative. But I don’t know the real situation.
So my conclusion is anyway, whether you leave him or not, to not be afraid to make big decisions like this, even if it turns out you made a mistake later. procrastination is the worst decision of all said some famous person. 🙂
We all need the courage to dig deep and own our decisions!