• bandwidthcrisis@lemmy.world
    link
    fedilink
    English
    arrow-up
    3
    ·
    2 hours ago

    AI runs in the cloud because it needs a powerful server to run the biggest (i.e. “smartest”) models.

    The cloud servers are doing nothing special that another powerful enough computer could do, just a huge amount of data processing.

    You can run an ai chat on a steam deck or directly on a phone, if it’s not too demanding (“smarter” models are bigger data files, so won’t fit in the memory of a small device).

    Today, for instance, I had a phone call from “Spectrum Internet support” and part-way through the call my phone blared an alarm and said “possible scam” on screen.

    The phone itself interpreted the conversation as sus.

    https://support.google.com/phoneapp/answer/15654065?hl=en

    For Pixel 9 and later devices: Scam Detection is powered by Gemini Nano on-device