• 8uurg@lemmy.world
    link
    fedilink
    English
    arrow-up
    2
    ·
    9 hours ago

    It doesn’t have to be on purpose. Web crawlers like Google’s specifically identify themselves as a bot. A headless browser just acts like any normal browser, and uses the same user agent as one, just controlled by code rather than a keyboard and mouse.