Yeah ... that's kind of a shitty move on the duke's part, not gonna lie. If he knew her background well enough and understands the struggles of living amongst the nobility, would he have changed his mind knowing her entire family would get pulled into his unbelievably selfish antics?
... Probably not, let's be honest.