This manga is way too low rated for its actual quality, this is genuinely good. A fairly fresh take on an isekai story, telling it from the perspective of a native of the world accompanying the hero, while also taking a more critical look at a lot of common isekai tropes. While I understand the perspective of people who are hating on the series because they dislike the attitude of the hero and party, that's also KIND OF THE POINT. The hero has the ridiculous idea of justice a lot of heroes in bad isekai series have, but here it's treated as a bad thing rather than the world just making everything work out. However the hero and party clearly have reasons behind their actions, as frustrating as those actions are, that will explain, though probably not excuse, their behavior and they'll likely have character arcs and grow as people.
Also the pacing is good, the main character is great, and the twists are actually pretty well foreshadowed in (relatively at least) subtle ways so that observant readers will be able to see most things coming without them being painfully obvious.
Seriously, 6.68 is so much lower than this series deserves, this is probably an 8 I'd say, at the very least a high 7, and I've seen barely passable crap get a higher rating than this series has.