So, if he goes back to the human world, it's basically become gay or a hermit, since women will likely continue to find he stinks as long as he lives. On the other hand, in the village he can have all the sex he may ever want, with adoring cute girls that throw themselves at him at every chance. Sorry but I don't get what problem he has with choosing, I know there are herbivore males but come on.
Perhaps there's some drawback I'm overlooking... Perhaps he's afraid he'll get a village-worth of nagging wives? Or that he'll be stuck doing all the small jobs in every one of his wives' houses?