The hard life in his 2nd life is because of his own stupidity.
Look, when so many humans in that world but only one man able to defeat a demon lord, why would he allowed people push him around?
Hell.. if I can solo kill a Godzilla, who’s gonna stop me from destroying one or two continents?