Damnnn his bro is so manipulative but i dont think he's the culprit. He just wants Set to be used only by him and only him.
Should Set be someone lovable, Set could lead a rebellion or sort because of him exhibiting good characteristics of a man or leader.