Circa 2000, the trope was totally reversed. Every romantic comedy main love interest ended up being a childhood friend then. I feel like the current situation is really just a reaction to that, but at this point everyone seems to have forgotten how it started.
The progenitor of the harem genre as we know it, Love Hina, had the childhood friend connection as its narrative core. Only the childhood friend could win.