It’s related to the historical correlation of paleness -> able to afford to stay inside -> rich.
If you have freckles, that means you work, or spend time, in the sun. Just like peasants. Whitening creams, lightening serums, skin bleaching, it’s all a thing.
Similar to this, wrinkles. Again...