I really have a hard time with this terror of any physical contact the Japanese seem to have. In what civilized world do you ask before helping a friend not smash her head in the pavement?!
Smart move
It's better to keep the toxic persona and have people "bully him" for the real wholesome him
That way it's one of those things for the ones who know.
After all the realization that he's actually a good guy adds spark