Of course, he hadn't totally recognized the realities himself; they'd let him have his fun with Midori, but afterwards... he still had to take care of their needs.
If he wants to cuddle with Midori afterwards, he has to take care of everyone else prior to being with Midori.
It's not maledom, it's not femdom, it's supply and demand, in a market where those with the demands have realized that the supply is sufficient for all of them if managed properly.
Properly speaking, it's not a harem as usually portrayed; the balance of power isn't correct for that.