this post was submitted on 29 May 2025
21 points (100.0% liked)
Technology
1134 readers
15 users here now
A tech news sub for communists
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Generally speaking would people want to run it on their own personal hardware? Or are there VPS-like services which allow people to run their own models?
For sure there are VPS services available for this. However, it's sad how much we need a powerful rig with 32GB RAM just to do regular development or test new FOSS stuff these days (for the sake of being melodramatic).