IMO I can see how Izumi would see it as his friends betraying him just like the adults betrayed him. Especially when, to him, more people walked out and abandoned him.
It was Kaede that drug Asahi's brother into the conversation to make his point derailing it because they were talking about...