Beyond the fact that he's the protagonist and thus not in any real danger, it's hard to feel too badly that this happened to him.
Also, I'm quickly tiring of isekai stories where the that element has little to no effect on the plot. Either make it a crucial component of the story or just don't include it in the first place.