Not only the shrinking populations, but also the smaller, countryside towns mostly populated by the elderly slowly dying off... but that sentence was mostly grounded on emotions than "science".
I don't think that gene diversity or even consanguinity would ever be a problem, they seem to have...