• grue@lemmy.world
    link
    fedilink
    English
    arrow-up
    14
    arrow-down
    4
    ·
    2 days ago

    Before you can punish for using LLMs, you need to be able to reliably detect the use of LLMs, including guarding against false positives.

    You can tell they’re using an LLM if they have a computer out during the pen-and-paper test.

    • OwOarchist@pawb.social
      link
      fedilink
      English
      arrow-up
      27
      arrow-down
      1
      ·
      2 days ago

      How is that allowed?

      Hell, back in my day, teachers were even very picky about what kind of calculator you could use. And if it was a graphing calculator, you had to show them yourself wiping the memory at the beginning of the test.

      (Except for one algerbra teacher, who was really cool about it. He’d allow custom programs to stay on the calculator if you programmed it yourself. On the theory that if you can write a computer program that reliably solves these math problems, then you must have a very good understanding of how to solve these math problems. And, yes, I was one of the few kids who actually did that. Ah, writing my own custom software for the TI-83 on the TI-83, because that seemed easier than actually doing the math problems by hand … good times.)

    • Railcar8095@lemmy.world
      link
      fedilink
      English
      arrow-up
      3
      ·
      1 day ago

      Not US, but there’s a tendency of focusing more on the work during the semester than in the exam itself

      LLMs are going to be a massive headache for me when they get older

      • OwOarchist@pawb.social
        link
        fedilink
        English
        arrow-up
        3
        ·
        1 day ago

        but there’s a tendency of focusing more on the work during the semester than in the exam itself

        Perhaps this tendency needs to be reversed?

        If you have one big exam (or a few of them spread over the year) that it’s impossible to use LLM help for and those exams carry enough weight to make the student fail the class if they completely bomb it … then you’ll be stopping the LLM-cheaters dead in their tracks. Sure, they can be lazy and do much of their coursework that way, but if they’re being lazy like that, they’re likely not actually learning anything, and that will show up during the big exams. And when they fail those big exams and then fail the class, hopefully they’ll learn their lesson about relying on LLMs to get them through classes.

      • grue@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        ·
        1 day ago

        Right, and that’s what’s going to have to change: a bigger focus on things like in-person tests (including in-person bluebook essays), oral presentations/thesis defenses instead of other project deliverables, etc.