In the earlier chapters, if I'm not mistaken.
The MC was okay with leaving his childhood friend to join his old party,the same people who tried to kill him, without warning her or even letting her know he was fine.
But here, he doesn’t want to leave that same old party alone, just in case...