I think thay he worries so much about this secret habit of his that he doesn't take the time to actually think about the fact that hardly anyone would believe what the class victim would say.Girl threatening him without a physical evidence and guy just accepts his fate, if Kitahara were to tell everyone in the class "X person did this!" no one's going to believe her anyway...