The fact that he knew she was going to show up and ask what they were doing. I can understand why the other dudes got jealous and/or despairing.
That's a level of understanding that even some married couples never manage to reach, and they aren't even dating yet.