1093
submitted 1 year ago by wiki_me@lemmy.ml to c/opensource@lemmy.ml
you are viewing a single comment's thread
view the rest of the comments
[-] Spzi@lemm.ee 2 points 1 year ago

Interesting, may I ask you a question regarding uncensored local / censored hosted LLMs in comparison?

There is this idea censorship is required to some degree to generate more useful output. In a sense, we somehow have to tell the model which output we appreciate and which we don't, so that it can develop a bias to produce more of the appreciated stuff.

In this sense, an uncensored model would be no better than a million monkeys on typewriters. Do we differentiate between technically necessary bias, and political agenda, is that possible? Do uncensored models produce more nonsense?

That's a good question. Apparently, these large data companies start with their own unaligned dataset and then introduce bias through training their model after. The censorship we're talking about isn't necessarily trimming good input vs. bad input data, but rather "alignment" which is intentionally introduced after.

Eric Hartford, the man who created Wizard (the LLM I use for uncensored work), wrote a blog post about how he was able to unalign LLAMA over here: https://erichartford.com/uncensored-models

You probably could trim input data to censor output down the line, but I'm assuming that data companies don't because it's less useful in a general sense and probably more laborious.

this post was submitted on 30 Sep 2023
1093 points (98.8% liked)

Open Source

31021 readers
645 users here now

All about open source! Feel free to ask questions, and share news, and interesting stuff!

Useful Links

Rules

Related Communities

Community icon from opensource.org, but we are not affiliated with them.

founded 5 years ago
MODERATORS