this post was submitted on 27 Jun 2026
400 points (97.2% liked)

Technology

85804 readers
3831 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[โ€“] T156@lemmy.world 4 points 13 hours ago (1 children)

The case recently resolved in the plaintiff's favour. though Google intends to appeal, so it's up in the air how things go.

And if it's this easy to poison the AIs, imagine how easy it is for someone with an actual agenda to mislead people in ways that aren't as fantastical and quickly spotted.

Equally concerning is that these systems are now seeing use in a range of things. There are lawyers who use it to file suits when they shouldn't be, and a US lawmaker was recently found to be using AI to draft laws. What happens when things like that make it into the models training data, rather than just being pulled in by RAG/web tools? They'd become part of the base knowledge of all the models of that line going forward.

It's funny when it's outlandish. The question becomes what happens when it isn't? Even without an agenda, what happens when it cites an outdated/incorrect source, or assumes that someone making a joke was correct, and ends up drawing from that when filling a lawsuit/drafting a law?

[โ€“] alianne@lemmy.world 3 points 12 hours ago

Thank you for finding the link! I've no doubt Google will fight for as long as they can, but hopefully the German courts will hold their ground.

I'm far from an expert, but I feel like this is one of the limiting factors of LLMs - they have no sense of broader context. Truth vs. lie, outdated info vs. something that's old but still correct... I'm not sure there's ever going to be an LLM (at least one built in the way they are now) that will be good at actually producing correct responses. Maybe one day we'll find a new way of achieving that goal, but I suspect what we're seeing now isn't going to be it.