It’s not just that, it’s shitting where it eats. People are using it to fill the internet with disinformation, then it trains itself on it’s own disinformation, and breeds even worse disinformation. This is why AI can never be smarter than it was in 2021.
On top of that, due to the indiscriminate DDOSing of the entire internet by AI bots, websites have been blocking any web crawlers that are not Google, which just contributes to their monopoly.
Our key finding is that by injecting information through an external synthetic data verifier, whether a human or a better model, synthetic retraining will not cause model collapse.
Yeah if you have a source of truth then your model is basically getting trained on that.
My point was that having a verifier means your not really training a model on another model’s data, it’s basically as if you get new raw data from a non AI source
This is true, depending on what you mean by smarter. They are undeniably more capable. However, the trendy, cool things is to hate on AI, rejecting all else. Sure, capitalism sucks, and the powerful rich people and companies who control AI suck. AI itself, though, can very easily result in massive benefits for humanity as a whole.
It’s not just that, it’s shitting where it eats. People are using it to fill the internet with disinformation, then it trains itself on it’s own disinformation, and breeds even worse disinformation. This is why AI can never be smarter than it was in 2021.
On top of that, due to the indiscriminate DDOSing of the entire internet by AI bots, websites have been blocking any web crawlers that are not Google, which just contributes to their monopoly.
Model collapse isn’t a thing anymore. https://arxiv.org/html/2510.16657v1
LOL OK
Yeah if you have a source of truth then your model is basically getting trained on that.
It’s like already having the answer
The point is that it only needs to comprise a very small part of the model.
My point was that having a verifier means your not really training a model on another model’s data, it’s basically as if you get new raw data from a non AI source
I’m pretty sure AI is objectively smarter today than it was 5 years ago.
How can something with no intelligence be smarter?
Since LLMs literally can’t learn, no. They’re just increasingly tweaked to seem even more convincing.
This is true, depending on what you mean by smarter. They are undeniably more capable. However, the trendy, cool things is to hate on AI, rejecting all else. Sure, capitalism sucks, and the powerful rich people and companies who control AI suck. AI itself, though, can very easily result in massive benefits for humanity as a whole.