Because it's always the MCs fault. He always gets blamed for whatever weakness, distrust, or misunderstanding that stems from the love interests.
It would still likely sow a lot of resentment. From a political point of view, a lesser noble is probably the best. Not someone with much power, so...