24
GPT-4 Understands (danangell.com)
submitted 1 year ago by narwhal@lemmy.ml to c/technology@lemmy.ml
you are viewing a single comment's thread
view the rest of the comments
[-] Veraticus@lib.lgbt 1 points 1 year ago

It's not from scratch, it's seeded and trained by humans. That is the intelligence.

[-] BitSound@lemmy.world 2 points 1 year ago

From scratch in the sense that it starts with random weights, and then experiences the world and builds a model of it through the medium of human text. That's because text is computationally tractable for now, and has produced really impressive results. There's no inherent need for text to be used though, similar models have been trained on time series data, and it will soon be feasible to hook up one of these models to a webcam and a body and let it experience the world on its own. No human intelligence required.

Also, your point is kind of silly. Human children learn language from older humans, and that process has been recursively happening for billions of years, all the way through the first forms of life. Do children not have intelligence? Or are you positing some magic moment in human evolution where intelligence just descended from the heavens and blessed us with it?

[-] FooBarrington@lemmy.world 1 points 1 year ago

Just like humans are! Do you know what happens when a human grows up without any training by other humans? They are essentially feral, unable to communicate, maybe even unable to think the way we do.

[-] Veraticus@lib.lgbt 1 points 1 year ago

LLMs do not grow up. Without training they don’t function properly. I guess in this aspect they are similar to humans (or dogs or anything else that benefits from training), but that still does not make them intelligent.

[-] FooBarrington@lemmy.world 2 points 1 year ago

What does it mean to "grow up"? LLMs get better at their tasks during training, just as humans do while growing up. You have to clearly define the terms you use.

[-] Veraticus@lib.lgbt 1 points 1 year ago

You used the term and I was using it with the same usage you were. Why are you quibbling semantics here? It doesn’t change the point.

[-] FooBarrington@lemmy.world 2 points 1 year ago

Yes, I used the term because "growing up" has a well-defined meaning with humans. It doesn't with LLMs, so I didn't use it with LLMs.

[-] Veraticus@lib.lgbt 1 points 1 year ago

Did you have a point or are you only trying to argue semantics?

[-] FooBarrington@lemmy.world 2 points 1 year ago

LLMs do not grow up.

You should ask yourself that question.

[-] Veraticus@lib.lgbt 0 points 1 year ago
[-] FooBarrington@lemmy.world 2 points 1 year ago

I don't know what your point was in asking that question, you should know yourself.

this post was submitted on 16 Oct 2023
24 points (62.2% liked)

Technology

34819 readers
64 users here now

This is the official technology community of Lemmy.ml for all news related to creation and use of technology, and to facilitate civil, meaningful discussion around it.


Ask in DM before posting product reviews or ads. All such posts otherwise are subject to removal.


Rules:

1: All Lemmy rules apply

2: Do not post low effort posts

3: NEVER post naziped*gore stuff

4: Always post article URLs or their archived version URLs as sources, NOT screenshots. Help the blind users.

5: personal rants of Big Tech CEOs like Elon Musk are unwelcome (does not include posts about their companies affecting wide range of people)

6: no advertisement posts unless verified as legitimate and non-exploitative/non-consumerist

7: crypto related posts, unless essential, are disallowed

founded 5 years ago
MODERATORS