Fun fact, this is why most ancient buildings didn't survive the years between antiquity and now. Not cause there was some big disaster that knocked them all over, but because good stone for building walls, houses, and castles isn't easy to come by. Only a third of the Roman Colosseum remains...