Welp this manga is trash.
Not because of the premise, but because the author isn't smart enough to add in the necessary world building to support it. Polygamy would be of course be the norm in such a world. Without it the risk/reward to kill off a taken man's wife would be huge. It would happen...