As someone from the duke's side, we know that he is trustworthy, however, he did grow up in a society where women are treated unequally, and is socially conditioned to do it. Although I think that his attitude is wrong, I don't think he meant to have any malicious intentions towards her but...