I believe in verifiable statements and so far,with few exceptions, I saw nothing. We are now speculating on magical numbers that we can’t see, but we know that ai is demanding and we know that even small models are not free. The only accessible data come from mistral, most other ai devs are not exactly happy to share the inner workings of their tools.
Even than, mistral didn’t release all their data, even if they did it would only apply to mistral 7b and above, not to chatgpt.
It’s cheaper though, so very likely it’s more efficient somehow.
I believe in verifiable statements and so far,with few exceptions, I saw nothing. We are now speculating on magical numbers that we can’t see, but we know that ai is demanding and we know that even small models are not free. The only accessible data come from mistral, most other ai devs are not exactly happy to share the inner workings of their tools. Even than, mistral didn’t release all their data, even if they did it would only apply to mistral 7b and above, not to chatgpt.
Important to point out this is really only valid towards Western AI companies. Chinese AI models have mostly been open source with open papers.