• melfie@lemmy.zip
    link
    fedilink
    English
    arrow-up
    2
    ·
    9 hours ago

    Yeah, there’s a lot of innovation going on to run powerful models on modest hardware and the state of the art for running local models is changing all the time. If the trend continues, models hosted in a data center will only be for niche use cases.