This is a manga so shit might not go down, but in real life his career, social standing, and other things could be destroyed. I mean obviously he has done it, so they wouldn't be false accusations, but if he hadn't even just the rumor would be detrimental.