If these aren't people from his old party, which I'm assuming they aren't because they're not fighting, I'm gonna go ahead and guess it's slaves. We've managed to go a whole 9 chapters without them, after all, it's about time they show up for the harem.