• ruan@lemmy.eco.br
    link
    fedilink
    arrow-up
    2
    ·
    edit-2
    4 hours ago

    Yes, but most of the paid “LLMs” are not actually just LLMs, they have specific aritimetic modules that end up being activated for most math questions that actual LLMs suck at, however are pretty easy for arithmetic modules, like simple calculations, unit conversions, etc…

    So yeah, any edge “LLM” tool currently will always get the original question asked here CORRECT even on the free tiers, you can test it yourself on Google Search itself in “AI mode”, on ChatGPT, or DeepSeek…

    So you are technically correctly in saying that LLMs suck and cannot be trusted for math in almost any case. However you are wrong on implying that ChatGPT, or other commercial models are just LLMs, they are not.

    P.S.: I’m not condoning the use of AI to resolve math related questiona, nor saying that their replies should be trusted, just stating the fact that actual “AI” products use more than just a large language model to generate their responses, and for math related questions most “AI” today will get arithmetic question answered correctly NOT DEPENDING on having training for the exact questiona being asked since they can identify a math arithmetic question being asked and instead of trying to fully generate the answer with the model itself, which would lack the training data to be able to process such wide range of possible question, they generate placeholders internally and let a arithmetic like module do the calculations, which take negligible processing power to be cacoulated by CPUs.