Bots are currently scraping the internet for LLM training data at unprecedented rates[1][2][3], driving up costs and destabilizing public-facing websites. I want to talk about how this has been particularly difficult for wikis, and has gotten much worse in the last few months.
It will probably go down, but the process itself is kind of unavoidable for training LLMs, so I doubt things will go back to how they were before.