To attempt an answer to your question, I ask: He saw you while his wife was living with him, but once she left him he no longer wants to see you- why do you think that is, what is the nature of his hurt (“I know he’s hurting”)?
* I will be back to the computer in about 13 hours, in case you reply to my question.
Love hurts. But make sure you are being true to yourself. Sounds like he has a lot on his plate. If taking a breather is what he needs right now than I suggest that’s what you do. He just may come out the other side of this a free man and all yours. Good luck.