Some_Emo_Chick@lemmy.world to Technology@lemmy.worldEnglish · 24 hours agoGenerative AI Is an Engineering Disaster. A shockingly inefficient trillion-dollar project.www.theatlantic.comexternal-linkmessage-square103fedilinkarrow-up1596arrow-down116cross-posted to: [email protected][email protected]
arrow-up1580arrow-down1external-linkGenerative AI Is an Engineering Disaster. A shockingly inefficient trillion-dollar project.www.theatlantic.comSome_Emo_Chick@lemmy.world to Technology@lemmy.worldEnglish · 24 hours agomessage-square103fedilinkcross-posted to: [email protected][email protected]
minus-squareAsafum@lemmy.worldlinkfedilinkEnglisharrow-up2·19 hours agoIt’s the q4 quantization, but it requires 20+GB vram and my 5080 only has 16
minus-squareDamage@feddit.itlinkfedilinkEnglisharrow-up2·11 hours agoMy framework 13 with shared RAM runs qwen quite well
It’s the q4 quantization, but it requires 20+GB vram and my 5080 only has 16
My framework 13 with shared RAM runs qwen quite well