So the only "real trouble" when the hero party meets ceres milf-team is probably them somehow finding out that their moms are basically ex-S-rank adventurers and that their moms were and probably still are the better ones at that, and that Ceres not being hero is probably still better than hero himself. Cause as long as he could probably be fine with Ceres being milf-lover thus there being no "fighting for girls" between them, he probably still has that "inferiority" complex somewhere inside him and wont like knowing Ceres could be stronger than him (or just having easier life with his moms-team compared to hero and his "loli" girls).
Well and then the fact that Ceres probably wont come back and solve their issues. The milf-team could take care of them together, but something tells me thats not the option Ceres nor the moms would choose. Moms will probably reap a new one on all 4 of them and push them away to learn to live on their own.
Girls finding out that Ceres had no interest in them romantically/lewdly wont probably hurt them cause at the same time they probably will understand that if they get into Ceres good side, their milf past 20 sex-less lifes wont be a given cause Ceres old-waifu loving could save them like he saved their moms. That saving their moms part would probably be why they wont get angry that he actually bangs them milfettes
.