Luu Tuyen@lemmy.world to Technology@lemmy.worldEnglish · 5 days agoTikTok’s parent launched a web scraper that’s gobbling up the world’s online data 25-times faster than OpenAIfortune.comexternal-linkmessage-square128fedilinkarrow-up1567arrow-down17
arrow-up1560arrow-down1external-linkTikTok’s parent launched a web scraper that’s gobbling up the world’s online data 25-times faster than OpenAIfortune.comLuu Tuyen@lemmy.world to Technology@lemmy.worldEnglish · 5 days agomessage-square128fedilink
minus-squareSomething Burger 🍔@jlai.lulinkfedilinkEnglisharrow-up15·4 days agohttps://github.com/iamtraction/ZOD 42kB ZIP file which decompresses into 4.5 PB.
minus-squareWhyJiffie@sh.itjust.workslinkfedilinkEnglisharrow-up2·3 days agowouldn’t it be trivial to defend against that with a hash check if the size matches? though I guess it’s possible to create your own that differs
https://github.com/iamtraction/ZOD
42kB ZIP file which decompresses into 4.5 PB.
wouldn’t it be trivial to defend against that with a hash check if the size matches?
though I guess it’s possible to create your own that differs