You might have invaded his privacy but what’s worse? Creeping on someone else’s phone OR creeping behind someone’s back to talk to other people?
You have to confront him about what you found. Hear what he has to say. Then, take the information you’ve gained from your conversation with him to come to a rational decision.