The fact that you are actually asking whether you should ask his side of the story kind of implies that you most likely will see him because most people it is a no brainer that they would run the other way as fast as possible. Please keep yourself safe and lose his number and maybe consider a therapist of your own. I am saying this with love in my heart. Your too kind, he is a monster, and at the very least someone with way to many hard issues that he needs to deal with ALONE.