Well then this change is just a bad change. The only thing it does is limit actual user. Scrapers can get past it as easy as pie. Again I don't wanna put on a thin foiled hat but sure does make you wonder.
but they won't thats how this works.
Think of it this way. you get 50 bucks for opening a door vs you get 50 bucks for climbing mount fuji.
sure if you go after the api you get better cleaning access but most scrapers don't give a shit when they have millions of sites they can scrape it's extra effort for no gain.
Why make the perfect program once when in that time you can get fifteen times the output with 10 half assed projects.
still a terrible solution don't mistake me.