25+ yr Java/JS dev
Linux novice - running Ubuntu (no windows/mac)

  • 0 Posts
  • 1.05K Comments
Joined 2 years ago
cake
Cake day: October 14th, 2024

help-circle
  • That sort of implies they have been dethroned in some way, but the opposite seems to be true. They are eating OpenAI’s lunch. Claude is widely considered the best development AI, and they just passed OpenAI in business customers.

    That said, they do post the most ridiculous blogs at times. Actually, I have yet to see a blog post by them that wasn’t complete bullshit, but that’s probably just selection bias. I assume they have some employees who aren’t complete morons.


  • I used Brave for a bit after it came out. All the built-in crypto bullshit wasn’t anything I ever touched. I can’t remember if I quit some time before Chrome announced the manifest-v3, or if that made me swear off all Chromium browsers for good.

    Anyway, also apparently the creators are huge assholes, so there is that, but as I never had any intent to support them financially I just thought I’d use a privacy-focused browser. Meh. Firefox has all the plugins a person could ever want.

    I mean, use whatever browser you like. Lemmy is cool and basically right about a lot of things, but fuck the zeitgeist and make up your own mind about shit. I went a different way, but forge your own path.




  • Having stared at my wife’s vag as she gave birth, you don’t want to see that. It’s amazing watching your child be born, but there is… it’s not a vagina as you know it. If I wasn’t able to compartmentalize and I saw that image in my head every time I had sex with my wife, I’d probably never have sex again.

    If someone offered to show me a video of my birth… I’d probably pass. The creature emerging from that portal to hell has no relation to what any is us became. Also, “I landed on a little poo,” isn’t something any of us wants to know.

    Somewhere out there are fetishists claiming the exception to the rule but… I’d think twice.






  • MagicShel@lemmy.ziptoProgramming@programming.devLocal LLM agents
    link
    fedilink
    English
    arrow-up
    2
    arrow-down
    1
    ·
    8 days ago

    I run this setup with 36GB (32+4). Local LLMs can be really effective BUT you are constrained by context size in a way you aren’t on cloud services.

    Cline supports running a local model through lmstudio but my experience feeding it any significant tasks is it just can’t handle reading and holding the contexts to build components for enterprise scale applications.

    I use Claude to write a lot of utility one-off scripts. With a maximum window of 1M tokens I can hit 30+% context just writing Python scripts. API contracts, development standards, existing reusable modules, and sometimes reading the code/documentation of the services I’m going to be calling.

    My MacBook can’t handle 300k token contexts. 30k seems doable. I should see how it handles my utility script folder…

    Anyway that’s still no Claude but if you need a cheaper model and you can afford for developers to spend time on it before ultimately deciding they need to spend for Claude or Codex or Gemini, then rubbing a local model on a beefy MacBook is 100% an option.

    Stepping up from there to building a locally hosted LLM is probably the worst of all worlds. It will be a beefy CapEx, prone to saturation by all the users, and you will most likely still have to punt the hardest jobs to cloud AI. It can certainly be done and done well, but the best example I know runs on $250-500k worth of hardware (to service a pretty big number of users to be fair).




  • I said vaguely. I’m not a communist or Marxist and recognize the limits of my understanding.

    The difference between owning the means of production and sharing ownership with investors feels meaningful but not diametrically opposed. Without the investors, the workers would STILL have to weigh their ownership stake against working conditions and determine what is in their best interest.

    I agree that bonuses being outside the workers control makes them not great overall, however in this case the bonus isn’t cash, but a stake in the company which again ties the payment to future performance. Not in a way the workers can directly control, but there is always going to be friction between what workers deserve to be paid for their work and what customers are willing to pay for the product. Ordinarily that friction serves to make investors fabulously rich and the workers largely get exploited.

    Anyway, I said vaguely and I stand by it. If you want to go in depth on your views of capitalism and Marxism, I promise to read and likely be fascinated. But I think you read that with a lot more intent than I originally meant to impart. I probably should’ve just left that bit out, knowing Lemmy users.