We’ve covered the AI scraper bots before. These just hit web pages over and over, at high speed, to scrape new training data for LLMs. They’re an absolute plague across the whole World Wide Web and…
Edit: But also - why do AI scrapers request pages that show differences between versions of wiki pages (or perform other similarly complex requests)? What’s the point of that anyway?
Gonna take a shot in the dark here and guess that the people behind these AI scrapers are incredibly stupid, and think Scrape More = More Data = More Growth = More GoodTM. Given this bubble’s already given us the goddamn scourge that is “vibe coding”, and is headed by growth-obsessed fuckwits and True BelieversTM, chances are I’m completely correct on this.
Gonna take a shot in the dark here and guess that the people behind these AI scrapers are incredibly stupid, and think Scrape More = More Data = More Growth = More GoodTM. Given this bubble’s already given us the goddamn scourge that is “vibe coding”, and is headed by growth-obsessed fuckwits and True BelieversTM, chances are I’m completely correct on this.