The main issue with Open / Local LLMs is the lack of broad support. It’s not hard for me to run Local LLMs, but apparently a decade of informal python experience and using linux mint is intimidating to some people. Apparently people want to click button and talk to phone god? Mostly speaks of a failing education system if you ask me.
I’m not even that good with AI, I just lurked a bit on [email protected] and got mine running at like 30 tokens/second on my laptop.
The main issue with Open / Local LLMs is the lack of broad support. It’s not hard for me to run Local LLMs, but apparently a decade of informal python experience and using linux mint is intimidating to some people. Apparently people want to click button and talk to phone god? Mostly speaks of a failing education system if you ask me.
I’m not even that good with AI, I just lurked a bit on [email protected] and got mine running at like 30 tokens/second on my laptop.