Luu Tuyen@lemmy.world to Technology@lemmy.worldEnglish · 29 days agoTikTok’s parent launched a web scraper that’s gobbling up the world’s online data 25-times faster than OpenAIfortune.comexternal-linkmessage-square131fedilinkarrow-up1573arrow-down17
arrow-up1566arrow-down1external-linkTikTok’s parent launched a web scraper that’s gobbling up the world’s online data 25-times faster than OpenAIfortune.comLuu Tuyen@lemmy.world to Technology@lemmy.worldEnglish · 29 days agomessage-square131fedilink
minus-squarejagged_circle@feddit.nllinkfedilinkEnglisharrow-up1arrow-down1·27 days agoCaches can be configured locally to use near-zero processing power. Or moved to the last mile to use zero processing power (by your hardware)
minus-squareOlgratin_Magmatoe@lemmy.worldlinkfedilinkEnglisharrow-up3·edit-227 days agoNear zero isn’t zero though. And not everyone is using caching.
minus-squarejagged_circle@feddit.nllinkfedilinkEnglisharrow-up1arrow-down1·27 days agoRight, thats why I said you should fire your sysadmin if they aren’t caching or can’t manage to get the cache down to zero load for static content served to simple GET requests
minus-squareOlgratin_Magmatoe@lemmy.worldlinkfedilinkEnglisharrow-up1·27 days agoNot every GET request is simple enough to cache, and not everyone is running something big enough to need a sysadmin.
Caches can be configured locally to use near-zero processing power. Or moved to the last mile to use zero processing power (by your hardware)
Near zero isn’t zero though. And not everyone is using caching.
Right, thats why I said you should fire your sysadmin if they aren’t caching or can’t manage to get the cache down to zero load for static content served to simple GET requests
Not every GET request is simple enough to cache, and not everyone is running something big enough to need a sysadmin.