Web novel reader here. It seems at this point the manga is going into SUPER HYPER SPEED TIME...probably because they got an ax notice and wanted to reach further plot points. So your confusion is understandable. Please read the full and well translated WN here for more details. This manga has been a not super great adaptation.