I think the author found a good compromise between erotic and wholesome, drama and wish-fullfilment so far.
It is quite funny that the guy seemed to want an harem but ended up a social outcast, still I think so far it has handled in an interesting way.