Is it? I've never once seen my neighbors from across the street and have no idea what they look like, despite having lived here for 20 years (even if I did see them and just don't remember it, the point's still there, I don't recall what they look like at all). I really don't find it weird at all.