this post was submitted on 25 Apr 2025
357 points (96.6% liked)

Technology

69298 readers
3882 users here now

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots

founded 2 years ago
MODERATORS
L3s@lemmy.world
enu@lemmy.world
technopagan@lemmy.world
L4s@lemmy.world
L3s@hackingne.ws
L4s@hackingne.ws
357
‘You Can’t Lick a Badger Twice’: Google Failures Highlight a Fundamental AI Flaw (www.wired.com)
submitted 1 day ago by Deebster@infosec.pub to c/technology@lemmy.world
96 comments fedilink hide all child comments
 

Archived link: https://archive.ph/Vjl1M

Here’s a nice little distraction from your workday: Head to Google, type in any made-up phrase, add the word “meaning,” and search. Behold! Google’s AI Overviews will not only confirm that your gibberish is a real saying, it will also tell you what it means and how it was derived.

This is genuinely fun, and you can find lots of examples on social media. In the world of AI Overviews, “a loose dog won't surf” is “a playful way of saying that something is not likely to happen or that something is not going to work out.” The invented phrase “wired is as wired does” is an idiom that means “someone's behavior or characteristics are a direct result of their inherent nature or ‘wiring,’ much like a computer's function is determined by its physical connections.”

It all sounds perfectly plausible, delivered with unwavering confidence. Google even provides reference links in some cases, giving the response an added sheen of authority. It’s also wrong, at least in the sense that the overview creates the impression that these are common phrases and not a bunch of random words thrown together. And while it’s silly that AI Overviews thinks “never throw a poodle at a pig” is a proverb with a biblical derivation, it’s also a tidy encapsulation of where generative AI still falls short.

you are viewing a single comment's thread
view the rest of the comments
[–] Liberteez@lemm.ee 12 points 20 hours ago (5 children)

I am not saying other generative AI lack flaws, but Google's AI Overview is the most problematic generative AI implementation I have ever seen. It offends me that a company I used to trust continues to force this lie generator as a top result for the #1 search engine. And to what end? Just to have a misinformed populace over literally every subject!

OpenAI has issues as well, but ChatGPT is a much, much better search engine with far fewer hallucinations per answer. Releasing AI Overview while the competition is leagues ahead on the same front is asinine!

[–] JeremyHuntQW12@lemmy.world 1 points 6 hours ago* (last edited 6 hours ago) (1 children)

Its a language model not a dictionary. By putting the term "definition" before the sentence you imply that the following sentence has a definintion, hence it vectors down to the most likely meaning.

[–] Liberteez@lemm.ee 1 points 5 hours ago

Buddy, I never said the word definition

[–] echodot@feddit.uk 2 points 10 hours ago

They famously taught it on Reddit. So it's not surprising that it just comes up with nonsense.

You would have thought that they would use a more stable data set. Although it does mean it's very good at explaining the plots of movies badly.

[–] Chulk@lemmy.ml 5 points 18 hours ago (1 children)

And to what end? Just to have a misinformed populace over literally every subject!

This is a feature; not a bug. We're entering a new dark age, and generative AI is the tool that will usher it in. The only "problem" generative AI is efficiently solving is a populace with too much access to direct and accurate information. We're watching as perfectly functional tools and services are being rapidly replaced by a something with inherent issues with reliability, ethics and accountability.

[–] Liberteez@lemm.ee 2 points 17 hours ago

In the case with Google AI overview, I 1000% agree. I am not against all AI tools, but that company has clearly chosen evil.

[–] klemptor@startrek.website 4 points 19 hours ago (1 children)

I've resorted to appending every Google search with "-ai" because I don't want to see their bullshit summaries. Outsourcing our thinking is lazy and dangerous, especially when the technology is so flawed.

[–] Liberteez@lemm.ee 3 points 19 hours ago

I like that trick, noted! I mostly use DuckDuckGo as a browser and search engine now. If it fails I use ChatGPT

[–] Modern_medicine_isnt@lemmy.world -2 points 18 hours ago (1 children)

Saying you used to trust google is really a core part of the problem. Google isn't a person. Just like AI isn't a person. They both do what they are tasked with. Companies prioritize profit. AI prioritizes giving an answer, not necessarily a correct one. That is how it was designed.

[–] Liberteez@lemm.ee 6 points 17 hours ago* (last edited 17 hours ago)

Impressive how we seem to agree with each other yet you still found a way to insult my way of putting it