Similar vibes than Reddit api pricing

  • CheeseNoodle@lemmy.world
    link
    fedilink
    English
    arrow-up
    3
    ·
    22 days ago

    Is it illegal to scrape? I mean most companies and governments scrape huge amounts of data all the time without getting anyones permission, hell the entire business of a search engine is basically WeScrape4U.

    • lemonskate@lemmy.world
      link
      fedilink
      English
      arrow-up
      6
      ·
      21 days ago

      If you extract a key from a proprietary client to decrypt a private API, it definitely is illegal. If you do this as a corporation, it would also be easy to detect by abnormal usage patterns tied to your account and presents you as a nice big set of pockets to get sued.

      Just screen scraping isn’t illegal, but is fragile as fuck and will break at the worst time and you have no ability to implement version control to manage it.

      • OmegaLemmy@discuss.online
        link
        fedilink
        English
        arrow-up
        2
        ·
        20 days ago

        Personally I wouldn’t want to be the guy forced to write scrapers with how much they break on any modern site