• Vlyn@lemmy.zip
    link
    fedilink
    English
    arrow-up
    3
    ·
    11 hours ago

    You have 170+ GB VRAM at home? (:

    I mainly use DeepSeek v4 Flash now, it’s the cheapest around and the quality is high enough for coding. At work we’re throwing tons of money at Claude, but even there I usually stick to Sonnet (as Opus is burning money).

    • De Lancre@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      4 hours ago

      You don’t need 170+ GB of VRAM. Whole model can be run at around 1 token/second on a modern hardware from an ssd. Which is slow, don’t get me wrong, but it still somewhat useable.