Let's see the positive side, he considers them close enough to ask for help getting home!
That these were just the first few years is probably the biggest reveal this chapter so many years left of this and he never realized (and she probably never got over being a tsundere.)