I'm sorry but don't you think that he should have kicked her out as soon as he became duke???? Like why would you keep your abuser around to teach your son with the knowledge that she taught you via abuse as well?????? Imo this plot hole is a bit too gaping to ignore