Did he really think that? — on the 17th page of the 4th chapter he is shown thinking “Come to think of it, there was only one girl in my class who called me by my nickname. All the other girls called me by my last name. She must've graduated already, since she was such an earnest person”, and thus it seems they're out of touch just because he dropped from his high school.