Yeah I dislike the choice that "you're OP in the dungeon, but in the outside world you're just a scrub" plot element. Also they're moving really fast, I think. Been a while since I read the novel, so Idrk if in the future he gains the ability to use use his powers outside the dungeon.