"Do they think I'm someone that can commit some incredible act of evil?"
I mean, I certainly think he can, the author is just being a pussy and keeping him "relatable", he did the same with Kazuma, not that that's a bad thing, it is a bit of a copout for us Evil lovers, however.