The Knights deserve to be punished, She is the lady of the house Not the Duchess and they were already given strict orders.
As her security and her guardians for they day they should never have left even if it made her upset. Its your responsibility as a bloody adult to what is right for your children,
or children in their care even if she has a tantrum.