He has known her for far too long to have any delusions anymore. Despite all the teasing, he knows nothing will happen. She will always put a stop to it before he can touch her, forget about anything more. His frustration and annoyance is understandable. Her behavior would be fine if things proceeded normally, but they never will.