Huh, this is difficult!
Here’s what I got from what you wrote, assuming there is nothing else hidden in there:
Even though he loves you, his plans for life are set … The way you describe it, he will not suddenly become experimental and he is even prepared to let you go, because he sees that this sort of life is not necessarily what YOU need.
I’ve seen this in some men, and they usually don’t change their minds. It sucks, because it sounds like you are willing to compromise and he does not seem to be willing to meet you somewhere on the way. You could interpret that as a lack of love, but it can be a fear of change and a personal decision as well. He obviously feels under pressure and thinks that he cannot fulfill your expectations.

So basically it is upon you to decide: Can you happily accept the situation you are now in, and spend your life there and with him – or do you want to trust the world and maybe his perspective and go out into the world?

How do you know he is the favorite person in the world when you don’t know every person in the world? There is more than one soulmate out there, and many different and fulfilling relationships to lead… I know for sure, because my first “soulmate” died, and I was forced to open myself up again to the world… and found someone whom I now cherish just as much!
Moreover, it is not completely unrealistic that you just need two or three years to figure out your own priorities and are able to take this relationship to a higher level afterwords. It happens. And if it doesn’t, it will be ok too!

Good luck and all the best!!!