Even a speck of dust annoys me if it gets on my lenses, but I've got a friend whose glasses had the entire lens surface regularly coated in fingerprints and hair oil, it was like looking through wax paper. Ended up cleaning them whenever we met since it drove me mad knowing about it.