Without considering things like bullshit story reasons or ulterior motives behind making those with magic power pariah, it seems the simple solution is to have a third collar to differentiate magic users from slaves. Poorly thought out system to make people with the potential to become walking nukes outcasts. This isn't the X-Men, it lewd story about a horny lonely guy's wish fulfillment. So any kind of greater societal commentary feels out of place.