this post was submitted on 24 Jun 2026
272 points (97.9% liked)

Technology

85719 readers
4159 users here now

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots

founded 3 years ago
MODERATORS
L3s@lemmy.world
enu@lemmy.world
technopagan@lemmy.world
L4s@lemmy.world
L3s@hackingne.ws
272
Advanced AI models suffer a near-total collapse on classic psychology test as cognitive demands increase (www.psypost.org)
submitted 1 day ago by sanitation@lemmy.today to c/technology@lemmy.world
92 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] zbyte64@awful.systems 1 points 12 hours ago* (last edited 12 hours ago) (1 children)

Aren't you the least bit curious what tools they gave the LLM and how the LLM used those tools? It's like back in math class you are asked to solve a quadratic formula but you forgot how. So you use the calculator to try different numbers and the calculator is telling you if you are getting closer. Sure I got the right answer, but it's hardly a testament to my math skills.

[–] communist@lemmy.frozeninferno.xyz 1 points 7 hours ago* (last edited 7 hours ago) (1 children)

The calculator does not tell them if they're getting closer? This isn't how anything works. No I can't say I'm very interested in whether or not the llm has access to python/a calculator as long as it completes the task, that doesn't matter.

[–] zbyte64@awful.systems 1 points 6 hours ago (1 children)

If you are not interested in how it completes the task then you are not an authority on how it works.

[–] communist@lemmy.frozeninferno.xyz 1 points 4 hours ago* (last edited 3 hours ago) (1 children)

I'm academically interested, what I mean when I say I'm not interested is that I just don't see the significance when we're talking about if it's capable of the task.

[–] zbyte64@awful.systems 1 points 3 hours ago (1 children)

How are you able to understand it's capability without understanding what tools it is capable of manipulating to effect?

[–] communist@lemmy.frozeninferno.xyz 1 points 2 hours ago

You aren't, and that's exactly what I'm saying, it's capable of doing these things with tools, therefore it's capable of doing these things.