this post was submitted on 29 May 2025
21 points (100.0% liked)

Technology

1134 readers
27 users here now

A tech news sub for communists

founded 2 years ago
MODERATORS
muad_dibber@lemmygrad.ml
21
How to Run Deepseek-R1-0528 Locally (unsloth.ai)
submitted 2 weeks ago by yogthos@lemmygrad.ml to c/technology@lemmygrad.ml
5 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[โ€“] ksynwa@lemmygrad.ml 2 points 1 week ago (1 children)

Generally speaking would people want to run it on their own personal hardware? Or are there VPS-like services which allow people to run their own models?

[โ€“] burlemarx@lemmygrad.ml 3 points 1 week ago

For sure there are VPS services available for this. However, it's sad how much we need a powerful rig with 32GB RAM just to do regular development or test new FOSS stuff these days (for the sake of being melodramatic).