I don't understand why denying power ? Sure, power is not everything but it can make your life a lot easier, power is important after all.
I was sick because of working or whatever so I just want a slow life, I don't need power...seem dumb imo.
In a world completely strange to you, the first thing you need is power, only with sufficient power can you be certain that you have a high chance to survive and thrive.
A slow life or harem or whatever is after that.