this post was submitted on 18 Jul 2026
188 points (98.0% liked)

Technology

86484 readers
3269 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 3 years ago
MODERATORS
 

The reality of how much damage AI mania is doing to our ability to run institutions effectively.

you are viewing a single comment's thread
view the rest of the comments
[–] XLE@piefed.social 68 points 2 days ago* (last edited 2 days ago) (2 children)

On several occasions, we’ve been exposed to folks that have been sort of lukewarm on our main offerings, but they really, really wanted to use AI to perform a natural language query on their data. And we thought “Okay, if you really want to see it, maybe we can caveat this appropriately and show you what it might look like.”

This was a terrible mistake. It backfired in the most predictable way imaginable – every lukewarm client that saw the chatbot in action, even with us telling them that it was not going to accomplish what they wanted, wanted to buy it immediately. Every other consideration, including millions of dollars that we could plausibly help them achieve by non-AI means, was swept aside. It was like a dark and terrible force seized control of their limbs, plunged their hands into their own chests, and presented their still-beating credit cards to us in grim supplication.

The writing here (and everywhere) is phenomenal, and this section echoes something I've seen Cal Newport say before, something along the lines that somebody with no technical knowledge sees one neat trick and suddenly assumes AI will turn into a superintelligence deity.

[–] HaraldvonBlauzahn@feddit.org 9 points 1 day ago* (last edited 1 day ago) (1 children)
[–] XLE@piefed.social 11 points 1 day ago

Warnings about it being “early days” and “hallucinations” both anthropomorphise the bot and provide ready-made excuses for when one of its constant failures are noticed.

Three years later and the "early days" routine is still going strong. Who would have thought?

[–] MangoCats@feddit.it 8 points 2 days ago (1 children)

What AI "decision making" does in our processes is: write the reports exactly like the procedure says they should be written, and fills them with whatever you want to hear - looking up convenient references to back up your opinions. You probably should double check the references yourself to be sure they actually exist (though I think AI is getting better at checking its own work for things like this lately) - but... yeah. Ask it once and it will give you "an opinion" that doesn't take into account all of the factors that matter to you. So, as you explain all the factors, it also becomes obvious what you want to hear, so after several rounds the obliging AI eventually not only "sees things your way" but can pile on the BS as deep as you ask it to to back up those opinions. What would have taken days to research and write can be done in an hour or so.

[–] Elting@piefed.social 7 points 1 day ago

It is the ultimate corporate yes-man that they could never quite get in a human. They have built it for C-suites who have control of the money but not their own faculties.