Hey :) For a while now I use gpt-oss-20b on my home lab for lightweight coding tasks and some automation. I’m not so up to date with the current self-hosted LLMs and since the model I’m using was released at the beginning of August 2025 (From an LLM development perspective, it feels like an eternity to me) I just wanted to use the collective wisdom of lemmy to maybe replace my model with something better out there.

Edit:

Specs:

GPU: RTX 3060 (12GB vRAM)

RAM: 64 GB

gpt-oss-20b does not fit into the vRAM completely but it partially offloaded and is reasonably fast (enough for me)

  • SuspciousCarrot78@lemmy.world
    link
    fedilink
    English
    arrow-up
    2
    ·
    edit-2
    3 hours ago

    Some examples

    • Tell Home Assistant to adjust lights/thermostat/locks in plain English based on certain conditions being met
    • Ask Jellyfin/Plex to play something based on a vague description like “something like Interstellar but lighter”
    • Morning briefing that pulls calendar, weather, emails and traffic into a 60-second summary automatically. Or get it to read it to you out loud while you shave.
    • Schedule the robot mower or vacuum based on weather forecast via API
    • Fetch information for you off net at set intervals and update you (email, SMS etc)
    • CCTV uses (classification etc)
    • Batch rename files, sort downloads, resize images - stuff you’d normally write a one-off script for
    • Parse a booking reply email, confirm the time, add it to your calendar, set reminders
    • Tag and name your own pictures based on meta data

    That’s probably just the basics. People have some clever uses for these things. It’s not just summarize this document

    • James R Kirk@startrek.website
      link
      fedilink
      English
      arrow-up
      1
      ·
      edit-2
      2 hours ago

      That’s cool, it just… does those things? How does it connect to those apps? I can’t even get Gemini to set a reminder and that’s on a Google device.