This part is really poorly done in the manga.
In the LN, after Rio healed himself, they relocated to a guest room where he explained everything. They realized their mistakes, then the 4 girls apologized with dogeza. After that, the scene switched to the elders' discussion.
It's really stupid for the manga to skip the apology.
The anime adapted this scene better.