i dunno where the line that it beats all the other models comes from when their own stats show they do worse across the board against the other big models, but they are close
I would have said the same thing as the author if I’d written that, counting ‘beating’ as being exceedingly cheaper while delivering comparable results, and doing it under sanctions. Deepseek makes a lot of sense for hobby projects because of the price, though I’m hearing about professional devs ditching Claude for V4-pro - but before deepseek, there was no reasonable solution for agentic at home, and you were stuck on debugging on the web interface.
Mind you speaking of benchmarks I have no idea what these things are actually supposed to represent lol. I found v4 good at recall and memory, but when talking to it (doing research, clarifying questions etc as opposed to just having it code), I found its overall output pretty diminished, like an old GPT 3.5 “you’re so right - and here’s why you are”. You can gloss over it but they had found a great mix by late 3.2 imo.
i dunno where the line that it beats all the other models comes from when their own stats show they do worse across the board against the other big models, but they are close
I would have said the same thing as the author if I’d written that, counting ‘beating’ as being exceedingly cheaper while delivering comparable results, and doing it under sanctions. Deepseek makes a lot of sense for hobby projects because of the price, though I’m hearing about professional devs ditching Claude for V4-pro - but before deepseek, there was no reasonable solution for agentic at home, and you were stuck on debugging on the web interface.
Mind you speaking of benchmarks I have no idea what these things are actually supposed to represent lol. I found v4 good at recall and memory, but when talking to it (doing research, clarifying questions etc as opposed to just having it code), I found its overall output pretty diminished, like an old GPT 3.5 “you’re so right - and here’s why you are”. You can gloss over it but they had found a great mix by late 3.2 imo.
I thought that claim wasn’t quite right. Maybe the author was just cherry picking certain stats or benchmarks.