Hentai with plot, like, literally.
He doesn't have permanent party members. So every "harem" member he collects means nothing, since they aren't seen anymore after he's done with their plot.
So don't get attached to the girls, tho why would you when most of them are prostitutes lol?