The dude is already out of university and is even someone's senior at work. I'd say the age difference is at the very minimum six years. If he was still a uni student, it wouldn't be as bad to consider a high school girl a girlfriend, but since he's already a working adult, I can understand his extreme hesitation. Once Kagari is out of high school, it should become easier for him.