Even if they are under the slavery contract thing, its entirely obvious that they trust him and are fond of him, even Palmyra that started as a antagonist. Also they arent brainwashed, Palmyra was tricked into it but she retains her personality and right after the fact she retained a antagonist behavior as well Himeno that have not changed much.