It's quite clear now that Addie actually has no respect for Mary and is probably only following the orders of her father, not really giving a damn about Mary herself. Not that I'd majorly blame him for it, seeing how Mary isn't exactly a smart person. It must be quite annoying to be her personal attendant. At least he can do whatever he wants, and simply apologising will make Mary forget everything. Funnily enough Mary seems to be aware of it all, but doesn't do anything about it, apart from empty threats she never puts into action.