• P03 Locke@lemmy.dbzer0.com
    link
    fedilink
    English
    arrow-up
    2
    ·
    21 hours ago

    I love fully local stuff, but the LLM part seems very expensive. Even for such a simple thing as managing our lights and music.

    Yeah, this is something I found out when I hacked my Amazon Echo and put LineageOS on it. I like the new interface that isn’t constantly advertising Amazon bullshit as a screensaver, but it doesn’t have a GPU, so attempting to put any sort of voice component takes many seconds to try to process.

    And in this post-memory-crisis economy, it’s not quite the right time to buy a dedicated LLM processing rig for my house. But, this really needs to be the route in the future. Or just install a NPU on this speaker itself. Phones already do this, and it’s been the standard since 2017.