I’m calling it now, the adoption of AI agents into software development will be one of the most costly mistakes in the field’s history. Agents cannot program, and it’s taking longer and longer to realize that they can’t. They are a highly sophisticated statistical model designed to mimic the distribution of programming. The output is broken, but in a way that’s getting harder and harder to detect. Which is exactly what you’d expect from an increasingly accurate statistical model.
Are you using real agents or the free chats on the web, because the latter ones are really dumb. Even when you ask them to search the web for basis you don’t get much success.
I haven’t paid
edit: Well I did for grok, but not on purpose. Grok still failed too.
The bigger paid models or potentially the local ones if given access to search the web can probably get you the right answers. The big ones have pretty much memorized half the internet, but can still be wrong so pushing them to verify their answers.
But the harder part is trusting what they say regardless. I can’t just take an answer for truth, and unless I can verify the statement (fact checking myself, looking up the source, running/testing the code, etc) then it gets harder to do anything with AI. This is the thing I hate about AI in general, people just take whatever they say at face value. Lawyers with fake citations, random people asking chatgpt about random facts and such. Its a tool that people put too much faith in to do thinking for them.