Weird enough, I think this harem(if we consider 2 girls a harem) could actually easily work for him.
I mean, it's obvious that both girls are in love with him, end he also has feelings for both of them. And unexpectedly, the girls are on a pretty good term with each other. No childish fights or jealousy.
It seems like they would actually be okay with both of them being his wives.
It's rare to see something like this in harem stories.