• azuth@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    2
    ·
    14 hours ago

    The kind that wants to not appear as a bot is unlikely to send a Linux user agent even if running on Linux.

    • 8uurg@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      9 hours ago

      It doesn’t have to be on purpose. Web crawlers like Google’s specifically identify themselves as a bot. A headless browser just acts like any normal browser, and uses the same user agent as one, just controlled by code rather than a keyboard and mouse.