Hi Lee,

The first time he started to doubt in you, the relationship was destined to fall apart.
All I can say right now is that you should evaluate your current situation, cons and pros of this relationship.
If you thought even for a second that this relationship can harm you in any way (feeling depressed or anxious all the time), you should brake up with him immediately.
If you continue like this (asuming you feel anxious and depressed), you could develop some disorders (like OCD) which you don’t want in your life, trust me (if you already don’t have one).

Be smart, stay strong and follow your dreams.
Karlo