A story like this makes me question the author.
The MC is rejected by them then he makes them his harem? Are you stupid?
Making them suffer, I can relate. Killing them, a bit too far but okay. Ignored and stay away from them, this is acceptable. But making them your harem?
Just like most of JN, the mc will probably be OP. The men will suffer but women who rejected the MC but in the end enter his harem, will not suffer or regret doing that, far from it. They will enjoy being protected and spoiled by the MC.
For me, this is the epitome of stupidity.