• subignition@fedia.io
    link
    fedilink
    arrow-up
    3
    ·
    1 month ago

    It’s not the scraping itself, but the purpose of the scraping, that can be problematic. There are good reasons for public sites to allow scraping.

    • General_Effort@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      1 month ago

      I have the distinct impression that a number of people would object to the purpose of re-hosting their content as part of a commercial service, especially one run by Google.

      Anyway, now no one has to worry about Google helping people bypass their robots.txt or IP-blocks or whatever counter-measures they take. And Google doesn’t have to worry about being sued. Next stop: The Wayback Machine.