You don't need to have status for a false rape accusation to ruin you. And Carnal relations with a woman under influence is considered rape in most cases, even if Himi would consent. All that's needed is a "good neighbor" to report it as such.
Just need to have someone witnessing him taking her home drunk and reporting it for it to end up in court and even if the court finds no wrongdoing, the social damage is already done and the gossip will ruin him.