LLMs are such a huge security liability, and noone seems to know how to properly secure them, probably because it is impossible. Yet very soon they will be incorporated in everything. Jensen Huang wants to sell you a box with an LLM controlling every single thing in your house.
Even a human support tech shouldn’t have that much power. That should be a request to a completely different team that gets hard off of telling people “No”.
It’s not impossible. It’s actually pretty simple. You just don’t give it access to credentials or resources or sensitive information of any kind. Does that make them basically useless? Yep. But then you don’t create massive security risks and legal liabilities with gross negligence either, so… gotta weigh those things against each other.
LLMs are such a huge security liability, and noone seems to know how to properly secure them, probably because it is impossible. Yet very soon they will be incorporated in everything. Jensen Huang wants to sell you a box with an LLM controlling every single thing in your house.
Even a human support tech shouldn’t have that much power. That should be a request to a completely different team that gets hard off of telling people “No”.
It’s not impossible. It’s actually pretty simple. You just don’t give it access to credentials or resources or sensitive information of any kind. Does that make them basically useless? Yep. But then you don’t create massive security risks and legal liabilities with gross negligence either, so… gotta weigh those things against each other.
You can do this and still use it to generate insecure code or even malicious code! Humans suck at reviewing
Unironically not a bad idea to have LLMs review eachothers code before committing. And then human review the PR.
Most likely because all the AI engineers are idiots without any coding experience to begin with.