It seems to me that these are "status effects" like in a game (like confusion). And the effect stacks up more and more if you're not careful. Sig seems to have some "skill" that helps to combat that - whenever he'd receive a bad status effect, his skill prevents it by reducing his emotions. Dia's skill does the opposite, although I think she got that skill because of her trauma, so these skills could be just a game-ified version of some mental defense mechanisms.
I think the rest is not trying enough. This manga has managed to strike a pretty good balance so far. The MC is strong, but not over powered, the world is not stupidly simple, and characters have motivations, that they act upon. I prefer this to the usual mindless isekai slop.
