15
submitted 9 months ago* (last edited 9 months ago) by rufus@discuss.tchncs.de to c/localllama@sh.itjust.works

They are referencing this paper: LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Dataset from September 30.

The paper itself provides some insight on how people use LLMs and the distribution of the different use-cases.

The researchers had a look at conversations with 25 LLMs. Data is collected from 210K unique IP addresses in the wild on their Vicuna demo and Chatbot Arena website.

you are viewing a single comment's thread
view the rest of the comments

IMO, local LLMs lack the capabilities or depth of understanding to be useful for most practical tasks (e.g. writing code, automation, language analysis). This will heavily skew any local LLM "usage statistics" further towards RP/storytelling (a significant proportion of which will always be NSFW in nature).

[-] rufus@discuss.tchncs.de 3 points 9 months ago* (last edited 9 months ago)

That is also my observation. Even for (simple) tasks like summarization, I've seen LLMs insert to much inaccurate information to be useful for my own life. The tasks I see are somewhat narrow and require a human in the loop. Despite some people claiming we're close to AGI.

this post was submitted on 26 Oct 2023
15 points (82.6% liked)

LocalLLaMA

2165 readers
1 users here now

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

founded 1 year ago
MODERATORS