this post was submitted on 07 Nov 2025
48 points (100.0% liked)
US News
2422 readers
32 users here now
News from within the empire - From a leftist perspective
founded 6 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
https://digitalspaceport.com/how-to-run-deepseek-r1-671b-fully-locally-on-2000-epyc-rig/ it's even better, this rig doesn't even have a GPU.
that is mind blowing! without a gpu at all and getting even 3 t/s? just... wow
And it's only going to get faster...
(Note that this is the Q4 model, but otherwise still the full 671b params and thinking mode enabled)
oh i missed that... yeah Q4 makes way more sense