This is the issue when you forget to give virtues to your MC. Now he's doing what most readers demand for in a harem setting and I can't cheer for him.
Why? Because he's dumb. And because he's dumb it makes his feelings come off as shallow. Going after a harem ending so easily makes one think he doesn't really care about the difficulties. It's the same problem I have with Highschool DxD's Issei, but engorged in the worst possible way. Unlike the latter, he hasn't grown in the least. He's still the same brainless pervert he was in chapter 1.