gerald_eliasweb@reddthat.com to Memes@lemmy.mlEnglish · edit-229 days agoHuman on the internet vs bot on the internetreddthat.comimagemessage-square15fedilinkarrow-up1359arrow-down15cross-posted to: [email protected]
arrow-up1354arrow-down1imageHuman on the internet vs bot on the internetreddthat.comgerald_eliasweb@reddthat.com to Memes@lemmy.mlEnglish · edit-229 days agomessage-square15fedilinkcross-posted to: [email protected]
minus-squarebrbposting@sh.itjust.workslinkfedilinkEnglisharrow-up15·6 months ago It was created by Xe Iaso in response to Amazon’s web crawler overloading their Git server, as it did not respect the robots.txt exclusion protocol and would work around restrictions. Jeff wouldn’t do that!
Jeff wouldn’t do that!