- cross-posted to:
- [email protected]
- cross-posted to:
- [email protected]
It’s hard for me how he recognizes all the (social) issues with LLMs and still comes to the conclusion that he isn’t in part responsible for them.
It’s hard for me how he recognizes all the (social) issues with LLMs and still comes to the conclusion that he isn’t in part responsible for them.
We know for a fact that LLMs have been trained on all available open source codebases.
Do we know that there is a relevant amount of closed source code in the training data?
Additionally to the other answer: Not all published source code is open souce, and I’m pretty sure, the scrapers didn’t stop to read the licence.md files on github
Corporate devs who use a non-self hosted LLM for developing their closed source apps are sending that code to the LLM’s servers, where it can be used as further training data (and considering how many of the corporate AI’s have purposefully trained their AI on pirated copyrighted content (like… A lot of them are doing that), it follows that they would train their AI on user prompts as well).