• chunes@lemmy.world
    link
    fedilink
    English
    arrow-up
    41
    arrow-down
    1
    ·
    1 day ago

    Using an LLM to parse stuff is like using a rocket launcher to kill an ant.

    You can accomplish the same thing using a million times fewer resources with a purpose-built program.

    • BradleyUffner@lemmy.world
      link
      fedilink
      English
      arrow-up
      13
      ·
      1 day ago

      Will, that’s what happens when employers tell employees that they should “use ai first”, track their token use on a dashboard, and tell them they’ll get fired if they are too low on the monthly ranking.

      • jj4211@lemmy.world
        link
        fedilink
        English
        arrow-up
        14
        ·
        1 day ago

        Yeah, my manager expressed satisfication with me being one of the people using my quota of tokens.

        I have generated so much throwaway content that never gets used and only gets deleted to burn the tokens to avoid getting the “you aren’t using AI enough” talk. The fact they can see my actual productive output and believe AI is involved shows how utterly disconnected the metric is from reality.

        • PattyMcB@lemmy.world
          link
          fedilink
          English
          arrow-up
          1
          ·
          8 hours ago

          It’s the same shit as tracking number of commits or lines of code committed, but magnified by a thousand.

        • frongt@lemmy.zip
          link
          fedilink
          English
          arrow-up
          2
          arrow-down
          1
          ·
          edit-2
          11 hours ago

          Damn how can I get a job whose primary KPI is just burning tokens?

          Edit: actually the answer is “Amazon consultant” based on the experience I had observing one of them “working”. He just repeatedly prompted their LLM and went around in circles instead of actually doing anything useful.

          • jj4211@lemmy.world
            link
            fedilink
            English
            arrow-up
            1
            ·
            9 hours ago

            I’ll say that it is only one thing.

            So if I just sat around burning tokens without anyone seeming to have any idea what I actually do around here I’d be out. If I just did my job but didn’t appear to use tokens, management would ding me for being some luddite.

    • jmp242@sopuli.xyz
      link
      fedilink
      English
      arrow-up
      17
      ·
      1 day ago

      Well, if your KPI is how much you use an LLM like in some reports - this is an easy way to get those good indicators. Also, LLMs are super easy to use to parse things, whereas many special programs like IDK grep isn’t exactly user friendly. Not to mention not finding patterns really. Though here I’m thinking things like looking at various logs on computers.

      • NotAnonymousAtAal@feddit.org
        link
        fedilink
        English
        arrow-up
        4
        ·
        1 day ago

        Maybe we could at least nudge the LLMs in the direction of suggesting appropriate tools and giving hints how to actually do that when applicable instead of blindly brute forcing every task. Of course that does not solve the issue of stupid corporate incentives, but I feel like by now most companies have realized that burning as much money as possible is not a good goal.

    • Rooster326@programming.dev
      link
      fedilink
      English
      arrow-up
      3
      arrow-down
      1
      ·
      1 day ago

      Yes but you’re in an open office and all you have available in your open office hell are: rocket launcher, your sanity, Debra’s snappy attitude.