This is one of those manga where I keep asking myself: "WHY!? WHY HAREM MANGA WHY!?"
This started out with a "cute daughter being cute" premise, and it devolves into: "children and teens are trying to get into his pants, and as a 30+ years old adult, he freaks out and has no idea how to react".
WHY!?
Why not just do: "he somehow adopts a bunch of cute kids. It's a story about having a cute arse family."
That's it. That's literally all it ever needed to be.
Instead, we have an MC who keeps being thrusted with the opportunity of female attraction, and he constantly rejects it.
How is that fun? How does that make a good story? When your MC constantly rejects something that appears like 2-3 times per chapter?
And, even worse, when the MC rejects these girls, it doesn't even mean anything.
The MC could be discussing about a serious plot thing, be attacked by the girls -- he blushes, scratches his nape, pushes them away, and goes: "well anyway.." and continues to discuss the serious plot thing.
You could literally remove every single harem comic-relief moment, and literally nothing about the story would change. It's so purely redundant, on the few levels I listed, that it actively detracts from any little thing that could've been fun in the story.
This low-key reminds me how the anime
Hagani's ("tomodachi") main source of conflict, is that the girls show interest in the MC, but the MC keeps being a harem-MC and actively ignores them, only this time the girls go : "No, NOT "
haha what was that? 
" you fucking listen to me and stop ignoring me".
While it's a "solid parody", I still find it annoying specifically because it equally plays on the dumbass MC who gets attention, but has no idea wtf to do with it.
I just wish harem-manga would have an MC who not only wants the attention, but can also deal with it. Why is that so hard? It's stupid.
This info dump has brought to you by someone who stumbled into way too many harem anime, and started losing his mind after 15 or so years.