We are given a direct clue (in this very chapter) that it was not the kiss that traumatized him but the thought that he could not be there in time for his childhood friend to save her, and not being there for her was caused by a conflict, and the conflict was his fault of not able to stay as a mere childhood friend with zero romcom feelings. Hence the mental suffering and the self-punishment from the inside.