Maybe not, but I want to guess theycmay end up as his slaves over this whole incident. Like he can't 'free' them without excessive money, or being a guardian, etc. so they become his slaves or say they already are or something along those lines.
Don't have much confidence in this, but I could see it happening given how the story has progressed so far. Mostly hope I'm wrong.