People shamed and ordered to leave shops after being misidentified then ‘given no help’ to investigate verdicts

  • nyan@lemmy.cafe
    link
    fedilink
    English
    arrow-up
    12
    ·
    3 hours ago

    The article notes (along with names of shops—vote with your money, if you’re in the UK), that the ID system being used has the usual racial bias (has a hard time with anyone who isn’t white) and also a gender bias (has an easier time IDing men). And that the provider was careful not to mention this until after people started complaining.

  • ryven@lemmy.dbzer0.com
    link
    fedilink
    English
    arrow-up
    46
    ·
    edit-2
    11 hours ago

    I suspect the claimed “99.98% accuracy” is counting out of all faces scanned, which is a bullshit way to make the tech look good. Most faces are not marked as shoplifters in the database. A system that literally does nothing would probably still have greater than 99% accuracy.

    What we really want to know is what percentage of reported matches are accurate, and I bet it isn’t anywhere near 99%.

    • Treczoks@lemmy.world
      link
      fedilink
      English
      arrow-up
      13
      ·
      9 hours ago

      I had to try to educate sales people what such numbers actually mean.

      With fingerprint readers, there are false positives (your finger is accepted, although it should not), and false negatives (your finger gets rejected although it should accept). The chances for both look small, but if you have 700+ people in the system, the chance of a random person to be accepted as one of the 700 is about bigger than 50%. And there was a big chance for any valid user to be logged in as someone else.

      • RunawayFixer@lemmy.world
        link
        fedilink
        English
        arrow-up
        4
        ·
        edit-2
        5 hours ago

        Pretty much this. A 0.02% error margin when there are tens of thousands of visitors per year, means it’s almost guaranteed to have errors.

        99.9% ^700 = 49.6% chance of no errors occurring.
        99.98% ^3466 = 50% chance of no errors occurring.
        99.98% ^23000 = 1% chance of no errors occurring.

  • deathbird@mander.xyz
    link
    fedilink
    English
    arrow-up
    8
    ·
    11 hours ago

    Funny how even the things “AI” is okay at (pattern matching within a certain margin of error) still can’t be used properly.

    • Ensign_Crab@lemmy.world
      link
      fedilink
      English
      arrow-up
      6
      ·
      9 hours ago

      Those using it don’t care if they get false positives, so it’s working as far as they’re concerned.

  • 「黃家駒 Wong Ka Kui」@piefed.ca
    link
    fedilink
    English
    arrow-up
    15
    arrow-down
    2
    ·
    14 hours ago

    Soon on TERF Island:

    They’re gonna have AI cameras to detect if you “went to the right gender bathroom”, and if AI decrees that you’ve entered the wrong one, they’ll flag you as a “sex offender”, then activate the terminators posted at the store to “eliminate sex offenders”

  • UnderpantsWeevil@lemmy.world
    link
    fedilink
    English
    arrow-up
    39
    arrow-down
    1
    ·
    19 hours ago

    Reminds me of the US No Fly List.

    No idea how your name gets on there. Impossible to remove. Every attempt to fly is a humiliation

  • Zeddex@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    22
    arrow-down
    1
    ·
    17 hours ago

    I guess UK and US governments viewed Minority Report as something to strive for rather than a cautionary tale?

    • No1@aussie.zone
      link
      fedilink
      English
      arrow-up
      18
      ·
      16 hours ago

      Well, they started with Orwell’s 1984, but that was 42 years ago and you can do so much more with technology now!

    • Buelldozer@lemmy.today
      link
      fedilink
      English
      arrow-up
      3
      arrow-down
      10
      ·
      edit-2
      16 hours ago

      First the US isn’t mentioned in this article. Second this is NOTHING like Minority Report. Your comment is dumber than a bucket of hair.

  • Deestan@lemmy.world
    link
    fedilink
    English
    arrow-up
    61
    arrow-down
    1
    ·
    20 hours ago

    I am not going to suggest, encourage, applaud and condone arson as a protest, because that is illegal.

    • brbposting@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      8
      ·
      9 hours ago

      These shoppers getting booted really steamed me. Individual stores, individual systems: that’s one (uncomfortable) thing. Sharing the data means disenfranchising. And when they go out of business someday the data of the whole country is sold to the highest bidder.

      Wish we could fix it legislatively so they don’t say “terrorism everywhere, need camera everywhere”. (One imagines that Flock CEO would love us to constantly wear bodycams…)

      btw on the internet gotta wonder if someone’s gonna read that & be like “oh let’s do it with 20 people inside

    • Fluffy Kitty Cat@slrpnk.net
      link
      fedilink
      English
      arrow-up
      13
      ·
      18 hours ago

      If it does happen the company has no one to blame but themselves, because when you abuse people like this there will be a backlash, it’s to be expected

      • Paragone@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        arrow-down
        1
        ·
        8 hours ago

        Backlash only means something when the entity getting backlashed is somehow hurt by that backlash.

        When the company’s immune to accountability, consequences, & responsibility, then … backlash changes nothing.

        The difference-in-leverage between citizens vs the companies doing this is now sooo huge, that there’s no significant chance of accountability or correction ever happening, in many countries.

        _ /\ _

    • Krusty@quokk.au
      link
      fedilink
      English
      arrow-up
      14
      arrow-down
      1
      ·
      20 hours ago

      That’s a possible life sentence if you get caught. Assuming there’s even a single person in the building.

  • Paragone@lemmy.world
    link
    fedilink
    English
    arrow-up
    0
    arrow-down
    2
    ·
    8 hours ago

    This means that due-process has to be made a constitutional-right, for criminal AND civil cases…

    _ /\ _