OpenAI’s Strawberry will turn you into paperclips any day now (pivot-to-ai.com)

submitted 4 months ago by dgerard@awful.systems to c/techtakes@awful.systems

24 comments fedilink hide all child comments

top 24 comments

sorted by: hot top controversial new old

[-] bitofhope@awful.systems 30 points 4 months ago

Reading and listening to fans of AI has actually managed to convince me that machine learning algorithms really are better at reasoning than some humans.

[-] blakestacey@awful.systems 27 points 4 months ago

The document describes a project that uses Strawberry models with the aim of enabling the company’s AI to not just generate answers to queries but to plan ahead enough to navigate the internet autonomously

Navigate the Internet that their software has already filled with shit. And the point of that would be...?

[-] o7___o7@awful.systems 24 points 4 months ago

It can seamlessly navigate all the way up its own ass, an artisanal reverse-Ouroboros.

[-] barsquid@lemmy.world 20 points 4 months ago

If they could make something that could navigate past all the bullshit they are producing, that'd be a really shrewd business move in a completely sociopathic end-stage capitalism sort of way.

[+] Donkter@lemmy.world -17 points 4 months ago* (last edited 4 months ago)

LLMs don’t do reasoning. Facts are not a data type in an LLM — the data is just tokens and the LLM tries to predict the next token. An LLM can look a bit like it’s reasoning as long as the correct answer is already in its training materials. [arXiv, PDF; arXiv, PDF; CustomGPT]

This is a weird kind of assertion. First of all. You could make facts a token value in an LLM if you had some pre-calculated truth value for your data set. That's not how it works now but it's a weird assertion to make about an unknown new generation of AI. As the author points out, facts kind of are a data type, it's just that the AI considers the most related words to the prompt to be the most correct, which of course, with a bad data set they are not.

Also, the current generation of ai, as admitted by the company, is not meant to be a tool for finding facts. It's a tool for generation, yes, a bit like an auto-complete but for natural language and with a much much wider scope.

What Strawberry apparently is, is a machine that reasons, which is NOT similar to what Open-AI ever claimed ChatGPT ever was. It's like a guy promised to bring a new animal to the village that will be able to pull the plow and the author is saying "this guy's full of shit! We have cats all over the village and even the biggest one could never pull a plow! They aren't designed for it! All animals are good for is catching mice!" And the guy brings in an Ox.

Edit: honestly my opinion of AI is lukewarm. I'm with a lot of people that the hype of it now being integrated into all sorts of nonsense is stupid. Its just that all of the bad arguments against it makes me tired.

[-] zbyte64@awful.systems 23 points 4 months ago

First of all. You could make facts a token value in an LLM if you had some pre-calculated truth value for your data set.

Why stop there? Just make consciousness a token value. See, AI is such an easy problem that me, a non-expert, is able to solve with just one sentence.

[-] self@awful.systems 21 points 4 months ago

First of all. You could simply prompt the LLM to become conscious, and I bet none of you so-called AI skeptics have noticed that Open-AI has NEVER included text like that in any of their system prompts.

[-] o7___o7@awful.systems 21 points 4 months ago* (last edited 4 months ago)

It can figure anything out with perfect reasoning, provided that that it has an oracle to verify facts.

For my next trick, watch me collapse the polynomial hierarchy [1]

^[1]^ ^quadraticaly^ ^faster^ ^than^ ^the^ ^time^ ^your^ ^mom^ ^sat^ ^on^ ^it^

[-] V0ldek@awful.systems 19 points 4 months ago* (last edited 4 months ago)

That’s not how it works now but it’s a weird assertion to make about an unknown new generation of AI.

Your quote is about LLMs, not "an unknown new generation of AI". Research on LLMs dates back at least to 1990s, they're neither new nor unknown.

What Strawberry apparently is, is a machine that reasons, which is NOT similar to what Open-AI ever claimed ChatGPT ever was.

Sammy boi claimed waaay wilder things than just "it reasons" about his grift so gtfo, this is some incredibly disingenuous apologetics for OpenAI.

Also, "apparently" is such a load-bearing word there.

[-] scruiser@awful.systems 17 points 4 months ago

First of all. You could make facts a token value in an LLM if you had some pre-calculated truth value for your data set.

An extra bit of labeling on your training data set really doesn't help you that much. LLMs already make up plausible looking citations and website links (and other data types) that are actually complete garbage even though their training data has valid citations and website links (and other data types). Labeling things as "fact" and forcing the LLM to output stuff with that "fact" label will get you output that looks (in terms of statistical structure) like valid labeled "facts" but have absolutely no guarantee of being true.

[-] self@awful.systems 15 points 4 months ago

This is a weird kind of assertion. First of all. You could make facts a token value in an LLM if you had some pre-calculated truth value for your data set. That’s not how it works now but it’s a weird assertion to make about an unknown new generation of AI.

fuck almighty where do you people pull this absolute horseshit from

What Strawberry apparently is, is a machine that reasons, which is NOT similar to what Open-AI ever claimed ChatGPT ever was.

well shit, you’ve got a long list of supposed AI researchers to tell that to. here, I’ll make sure you’ve got plenty of time to read their back catalog of utterly fucking stupid claims!

[-] sc_griffith@awful.systems 13 points 4 months ago

guy who sucks at being a person sees great potential in ai

[-] fasterandworse@awful.systems 12 points 4 months ago* (last edited 4 months ago)

I'd like to see any evidence of openai concretely saying what chatgpt is for.

[-] fasterandworse@awful.systems 8 points 4 months ago

I'll wait

[-] pikesley@mastodon.me.uk 10 points 4 months ago

@Donkter @dgerard have you bumped your head?

this post was submitted on 13 Jul 2024

50 points (100.0% liked)

TechTakes

1441 readers

45 users here now

Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.

This is not debate club. Unless it’s amusing debate.

For actually-good tech, you want our NotAwfulTech community

founded 1 year ago

MODERATORS

dgerard@awful.systems