☆ Yσɠƚԋσʂ ☆@lemmygrad.ml to US News@lemmygrad.mlEnglish · 6 days agoSo OpenAI strategy was to become too big to fail and live off government bailouts. Nothing says free market like a public safety net for private billion-dollar bets. A beautiful capitalist fairy tale.www.barrons.comexternal-linkmessage-square13fedilinkarrow-up150arrow-down10cross-posted to: [email protected]
arrow-up150arrow-down1external-linkSo OpenAI strategy was to become too big to fail and live off government bailouts. Nothing says free market like a public safety net for private billion-dollar bets. A beautiful capitalist fairy tale.www.barrons.com☆ Yσɠƚԋσʂ ☆@lemmygrad.ml to US News@lemmygrad.mlEnglish · 6 days agomessage-square13fedilinkcross-posted to: [email protected]
minus-squarePeeOnYou [he/him]@lemmygrad.mllinkfedilinkarrow-up2·5 days agothere is no way you’re running the full deepseek model on a $2000 gpu much less computer
minus-squareCriticalResist8@lemmygrad.mllinkfedilinkarrow-up6·5 days agohttps://digitalspaceport.com/how-to-run-deepseek-r1-671b-fully-locally-on-2000-epyc-rig/ it’s even better, this rig doesn’t even have a GPU.
minus-squarePeeOnYou [he/him]@lemmygrad.mllinkfedilinkarrow-up1·1 day agothat is mind blowing! without a gpu at all and getting even 3 t/s? just… wow
minus-squareCriticalResist8@lemmygrad.mllinkfedilinkarrow-up2·1 day agoAnd it’s only going to get faster… (Note that this is the Q4 model, but otherwise still the full 671b params and thinking mode enabled)
minus-squarePeeOnYou [he/him]@lemmygrad.mllinkfedilinkarrow-up2·14 hours agooh i missed that… yeah Q4 makes way more sense
there is no way you’re running the full deepseek model on a $2000 gpu much less computer
https://digitalspaceport.com/how-to-run-deepseek-r1-671b-fully-locally-on-2000-epyc-rig/ it’s even better, this rig doesn’t even have a GPU.
that is mind blowing! without a gpu at all and getting even 3 t/s? just… wow
And it’s only going to get faster…
(Note that this is the Q4 model, but otherwise still the full 671b params and thinking mode enabled)
oh i missed that… yeah Q4 makes way more sense