For me, this is the point in which the WN started going sour.
The MC cares more about "being a mob", than he cares about "being a shadow". He never tries to develop his ambitions or even create any. In the WN, it started to break the story apart, as the author truly tried to move the story somewhere, but his MC stayed the same as ever; the focus of the story turns to focus on "uncovering the history of the nation, the cult, etc", and not the MC's random antics. Every single character tries to take to move the story forward, but only the MC is stuck playing his childish gags.
The whole misunderstanding gag would be somewhat fine if that's all there was to it. But the story tries so hard to become "serious" at some point, that the MC becomes an actual detriment and liability to the story. Heck, it's specifically because the author tries to HAVE a story, is why the MC becomes such a pain. Everyone else are moving forward, but he doesn't.
Also, just a note: like 100 or so chapters are broken and lost in novelupdates. If you still *really* want to read ahead, you have to use the internet-archives.