Hey :) For a while now I use gpt-oss-20b on my home lab for lightweight coding tasks and some automation. I’m not so up to date with the current self-hosted LLMs and since the model I’m using was released at the beginning of August 2025 (From an LLM development perspective, it feels like an eternity to me) I just wanted to use the collective wisdom of lemmy to maybe replace my model with something better out there.

Edit:

Specs:

GPU: RTX 3060 (12GB vRAM)

RAM: 64 GB

gpt-oss-20b does not fit into the vRAM completely but it partially offloaded and is reasonably fast (enough for me)

  • James R Kirk@startrek.websiteEnglish
    2·
    8 hours ago

    Just curious, what does “some automation” entail? I thought LLMs could only work with text, like summarize documents and that sort of thing.

    • SuspciousCarrot78@lemmy.worldEnglish
      2·
      3 hours ago

      Some examples

      • Tell Home Assistant to adjust lights/thermostat/locks in plain English based on certain conditions being met
      • Ask Jellyfin/Plex to play something based on a vague description like “something like Interstellar but lighter”
      • Morning briefing that pulls calendar, weather, emails and traffic into a 60-second summary automatically. Or get it to read it to you out loud while you shave.
      • Schedule the robot mower or vacuum based on weather forecast via API
      • Fetch information for you off net at set intervals and update you (email, SMS etc)
      • CCTV uses (classification etc)
      • Batch rename files, sort downloads, resize images - stuff you’d normally write a one-off script for
      • Parse a booking reply email, confirm the time, add it to your calendar, set reminders
      • Tag and name your own pictures based on meta data

      That’s probably just the basics. People have some clever uses for these things. It’s not just summarize this document

      • James R Kirk@startrek.websiteEnglish
        1·
        2 hours ago

        That’s cool, it just… does those things? How does it connect to those apps? I can’t even get Gemini to set a reminder and that’s on a Google device.

    • a1studmuffin@aussie.zoneEnglish
      3·
      7 hours ago

      These days they can also chain together tools, keep a working memory etc. Look at Claude Code if you’re curious. It’s come very far very quickly in the last 12 months.