I see your point, but I think there are different sentiments in "You shouldn't have liked me" and in "There was no way she could like me". In the first case, it's deciding for the other person, in the second case, it's merely weighing your own chances.
Besides, he already said that in chapter...