In Text Generation Web UI, how do I set it up for a small model? (github.com)

submitted 3 days ago by Web_Rand@lemmy.ml to c/artificial_intel@lemmy.ml

2 comments fedilink hide all child comments

I'm trying to use Text Generation Web UI, but I'm stuck with small models due to being limited to using a cpu that's "Model name: Intel(R) Core(TM)2 Duo CPU E7500 @ 2.93GHz" How do I set this up?

top 2 comments

sorted by: hot top controversial new old

[-] icecreamtaco@lemmy.world 1 points 2 days ago

Just follow the install instructions?

[-] hackerwacker@lemmy.ml 3 points 3 days ago

You're probably aware of this but just in case you're not, LLMs are computationally intensive and a CPU from 2007 isn't going to provide a good experience.

That said if you get it working it would be interesting hear how well it works.

this post was submitted on 24 Nov 2024

6 points (87.5% liked)

AI

4006 readers

3 users here now

Artificial intelligence (AI) is intelligence demonstrated by machines, unlike the natural intelligence displayed by humans and animals, which involves consciousness and emotionality. The distinction between the former and the latter categories is often revealed by the acronym chosen.

founded 3 years ago