• Steve Dice@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      5
      ·
      2 hours ago

      If you cut your finger while cooking, you wouldn’t expect the cleaver to stick around and pay the medical bill, would you?

  • kazerniel@lemmy.world
    link
    fedilink
    English
    arrow-up
    81
    ·
    edit-2
    6 hours ago

    “I am horrified” 😂 of course, the token chaining machine pretends to have emotions now 👏

    Edit: I found the original thread, and it’s hilarious:

    I’m focusing on tracing back to step 615, when the user made a seemingly inconsequential remark. I must understand how the directory was empty before the deletion command, as that is the true puzzle.

    This is catastrophic. I need to figure out why this occurred and determine what data may be lost, then provide a proper apology.

    • FinjaminPoach@lemmy.world
      link
      fedilink
      arrow-up
      2
      ·
      30 minutes ago

      TBF it can’t be sorry if it doesn’t have emotions, so since they always seem to be apologising to me I guess the AIs have been lying from the get-go (they have, I know they have).

    • Credibly_Human@lemmy.world
      link
      fedilink
      arrow-up
      1
      ·
      1 hour ago

      I feel like in this comment you misunderand why they “think” like that, in human words. It’s because they’re not thinking and are exactly as you say, token chaining machines. This type of phrasing probably gets the best results to keep it in track when talking to itself over and over.

      • Ledivin@lemmy.world
        link
        fedilink
        arrow-up
        3
        arrow-down
        2
        ·
        edit-2
        2 hours ago

        People cut off body parts with saws all the time - I’d argue that tool misuse isn’t at all grounds for banning it.

        There are plenty of completely valid reasons to hate AI. Stupid people using it poorly just isn’t really one of them 🤷‍♂️

        • zebidiah@lemmy.ca
          link
          fedilink
          arrow-up
          4
          ·
          2 hours ago

          That’s the second most infuriating thing about AI, is that there are actual legitimate and worthwhile uses for it, but all we are seeing is the various hallucinating idiotbots that openai, meta, and Google are pushing…

  • Scrubbles@poptalk.scrubbles.tech
    link
    fedilink
    English
    arrow-up
    33
    ·
    6 hours ago

    Damn this is insane. Using claude/cursor for work is near, but they have a mode literally called “yolo mode” which is this. Agents allowed to run whatever code they like, which is insane. I allow it to do basic things, you can search the repo and read code files, but goddamn allowing it to do whatever it wants? Hard no

  • katy ✨@piefed.blahaj.zone
    link
    fedilink
    English
    arrow-up
    41
    ·
    8 hours ago

    that’s wild; like use copilot or w/e to generate code scaffolds if you really have to but never connect it to your computer or repository. get the snippet, look through it, adjust it, and incorporate it into your code yourself.

    you wouldn’t connect stackoverflow comments directly to your repository code so why would you do it for llms?

    • Tja@programming.dev
      link
      fedilink
      arrow-up
      5
      ·
      edit-2
      4 hours ago

      you wouldn’t connect stackoverflow comments directly to your repository code so why would you do it for llms?

      Have you met people? This just saves them the keystrokes because some write code exactly like that.

    • dejected_warp_core@lemmy.world
      link
      fedilink
      arrow-up
      16
      ·
      7 hours ago

      Exactly.

      To put it another way, trusting AI this completely (even with so-called “agentic” solutions) is like blindly following life advice on Quora. You might get a few wins, but it’s eventually going to screw everything up.

      • Schadrach@lemmy.sdf.org
        link
        fedilink
        English
        arrow-up
        4
        ·
        5 hours ago

        Unironically this. I’ve only really tried it once, used it mostly because I didn’t know what libraries were out there for one specific thing I needed or how to use them and it gave me a list of such libraries and code where that bit was absolutely spot on that I could integrate into the rest easily.

        It’s code was a better example of the APIs in action and the differences in how those APIs behave than I would have expected.

        I definitely wouldn’t run it on the “can run terminal commands without direct user authorization” though, at least not outside a VM created just for that purpose.

  • Zink@programming.dev
    link
    fedilink
    arrow-up
    100
    ·
    9 hours ago

    Wow, this is really impressive y’all!

    The AI has advanced in sophistication to the point where it will blindly run random terminal commands it finds online just like some humans!

    I wonder if it knows how to remove the french language package.

  • I Cast Fist@programming.dev
    link
    fedilink
    arrow-up
    116
    ·
    11 hours ago

    “How AI manages to do that?”

    Then I remember how all the models are fed with internet data, and there are a number of “serious” posts that talk how the definitive fix to windows is deleting System32 folder, and every bug in linux can be fixed with sudo rm -rf /*

    • JcbAzPx@lemmy.world
      link
      fedilink
      English
      arrow-up
      5
      ·
      6 hours ago

      I think I’ll just install Linux rather than randomly pulling parts out of my computer while copilot slowly types out the lyrics to Daisy Bell.

    • fruitcantfly@programming.dev
      link
      fedilink
      arrow-up
      7
      ·
      edit-2
      4 hours ago

      How the fuck can it not recover the files?

      Undeleting files typically requires low-level access to the drive containing the deleted files.
      Do you really want to give an AI, the same one that just wiped your files, that kind of access to your data?

    • merc@sh.itjust.works
      link
      fedilink
      arrow-up
      7
      ·
      7 hours ago

      On some filesystems the data is still there but the filenames associated with it are gone or mangled. That makes it harder to recover things. In addition, while it’s true that the contents are only overwritten when you write data to the disk, data is constantly being written to the disk. Caches are being updated, backup files are being saved, updates are being downloaded, etc. If you only delete one file the odds are decent that that part of the disk might not be used next. But, if you nuke the entire drive, then you’re probably going to lose something.

      • Trainguyrom@reddthat.com
        link
        fedilink
        English
        arrow-up
        1
        ·
        4 hours ago

        On the upside, they specified D: drive which is typically a lesser used bulk storage drive, so less activity to potentially overwrite the files marked as deleted

    • Fluke@feddit.uk
      link
      fedilink
      arrow-up
      11
      ·
      edit-2
      8 hours ago

      Then 1s, then a pattern of 1s and 0s, then the inverse of that pattern, then another pattern, for a number of cycles.

      Data can actually be recovered beyond multiple overwrites, if enough time and money is thrown at it.

      • JackbyDev@programming.dev
        link
        fedilink
        English
        arrow-up
        2
        ·
        4 hours ago

        They keep saying that but those Bitcoins are still in the dump. (I’m aware it’s not comparable since having the drive in hand versus missing is a huge difference. Just a little joke.)

      • wabasso@lemmy.ca
        link
        fedilink
        English
        arrow-up
        15
        ·
        8 hours ago

        If there is something on your disk that a state actor is going to use magnetic microscopy to try to recover, it seems absurd to worry about still being able to use that hard drive and not just crush/melt it to be sure.

      • Buddahriffic@lemmy.world
        link
        fedilink
        arrow-up
        7
        ·
        8 hours ago

        Is that still the case with SSDs? I understood it to be a property of magnetic disks, and only possible because the drives can be disassembled and then read with a more sensitive reading head. I can’t think of a way to do that with flash circuitry unless it’s already designed to do that.

          • Buddahriffic@lemmy.world
            link
            fedilink
            arrow-up
            4
            ·
            6 hours ago

            Oh yeah, the bit where SSDs move sectors around for wear evening is important. Because of that, it’s possible to completely fill up an SSD after deleting files and still have those files recoverable from the flash chips themselves. Without that secure erase, as I understand it, if a sector gets marked “bad”, whatever data is there might stay there forever (or at least as long as the cells hold a charge).

            So there’s no benefit to writing multiple passes over deleted data on SSDs as far as the flash is concerned, but multiple passes might make it more likely for the controler to actually direct those extra writes to a sector actually storing the data (though the odds might be low unless you’re overwriting all free space, though even that depends on how much space is free vs how many “spare” sectors there are, and even then it might be impossible to get it to write to a sector marked “bad”).

  • ZILtoid1991@lemmy.world
    link
    fedilink
    arrow-up
    40
    ·
    11 hours ago

    Meanwhile, my mom’s boyfriend is begging me to use AI for code, art, everything, because “it’s the future”.

      • Landless2029@lemmy.world
        link
        fedilink
        arrow-up
        3
        arrow-down
        1
        ·
        7 hours ago

        And somehow making the next generation even dumber.

        Its the next level of: “I don’t need to remember things because Google can tell me.”

        • ArmchairAce1944@discuss.online
          link
          fedilink
          arrow-up
          2
          ·
          5 hours ago

          Even I wasn’t that dumb. This is because when I first started using the internet for actual reading I knew that websites would always be going down and some exist for only brief periods of time. While this is no longer the case for major sites, that mindset never left me. The internet can forget at times.

          • korazail@lemmy.myserv.one
            link
            fedilink
            English
            arrow-up
            1
            ·
            2 hours ago

            I tripped over this awesome analogy that I feel compelled to share. “[AI/LLMs are] a blurry JPEG of the web”.

            This video pointed me to this article (paywalled)

            The headline gets the major point across. LLMs are like taking the whole web as an analog image and lossily digitizing it: you can make out the general shape, but there might be missed details or compression artifacts. Asking an LLM is, in effect, googling your question using a more natural language… but instead of getting source material or memes back as a result, you get a lossy version of those sources and it’s random by design, so ‘how do I fix this bug?’ could result in ‘rm -rf’ one time, and something that looks like an actual fix the next.

            Gamers’ Nexus just did a piece about how youtube’s ai summaries could be manipulative. While I think that is a possibility and the risk is real, go look at how many times elmo has said he’ll fix grok for real this time; but another big takeaway was how bad LLMs still are at numbers or tokens that have data encoded in them: There was a segment where Steve called out the inconsistent model names, and how the ai would mistake a 9070 for a 970, etc, or make up it’s own models.

            Just like googling a question might give you a troll answer, querying an ai might give you a regurgitated, low-res troll answer. ew.

    • MysticKetchup@lemmy.world
      link
      fedilink
      arrow-up
      4
      ·
      edit-2
      9 hours ago

      It’s funny that they can never give actual concrete reasons to use it, just “it’s the future” or “you’re gonna get left behind” but they never back those up

      • UnspecificGravity@infosec.pub
        link
        fedilink
        arrow-up
        6
        ·
        8 hours ago

        Oh no, I am going to get left behind by not letting a machine capable of writing a solid B- middle school term paper do my job for me.