Programming

26050 readers

79 users here now

Welcome to the main community in programming.dev! Feel free to post anything relating to programming here!

Cross posting is strongly encouraged in the instance. If you feel your post or another person's post makes sense in another community cross post into it.

Hope you enjoy the instance!

Rules

Follow the programming.dev instance rules
Keep content related to programming in some way
If you're posting long videos try to add in some form of tldr for those who don't want to watch videos

Wormhole

Follow the wormhole through a path of communities !webdev@programming.dev

founded 2 years ago

MODERATORS

snowe@programming.dev

Ategon@programming.dev

UlrikHD@programming.dev

bugsmith@programming.dev

Spyro@programming.dev

METR AI Coding Research Inconclusive Because Dev Participants Refused to Complete Tasks Without AI (metr.org)

submitted 3 days ago* (last edited 3 days ago) by brianpeiris@lemmy.ca to c/programming@programming.dev

23 comments fedilink hide all child comments

Selected developer quotes:

“I’m torn. I’d like to help provide updated data on this question but also I really like using AI!” — a developer from the original study early-2025 when asked to participate in the late-2025 study.

“I found I am actually heavily biased sampling the issues … I avoid issues like AI can finish things in just 2 hours, but I have to spend 20 hours. I will feel so painful if the task is decided as AI-disallowed.” — a developer from the new study noting selection effects when choosing what tasks to include in the study.

“my head’s going to explode if I try to do too much the old fashioned way because it’s like trying to get across the city walking when all of a sudden I was more used to taking an Uber.” — a developer from the new study noting selection effects when choosing what tasks to include in the study.

you are viewing a single comment's thread
view the rest of the comments

[–] FizzyOrange@programming.dev 1 points 15 hours ago (1 children)

Not everyone that runs is an avid runner.

But I do feel like the analogies aren't that great. Coding in notepad instead of an IDE is dumb because IDEs work and don't really have any downsides. AI mostly seems to produce slop that barely works without a ton of cajoling.

[–] hperrin@lemmy.ca 2 points 15 hours ago (1 children)

What I meant with the runner analogy is that coding is a skill just like running. If you let a machine do it for you for long enough, you lose that skill.

[–] FizzyOrange@programming.dev 1 points 10 hours ago* (last edited 10 hours ago)

Yeah I know, but if you really mean that analogy then the conclusion is that the normal thing for 99% of programmers to do should be to use AI. In the same way that 99% of people do not get around by running.

I don't agree with that yet - so far I've found AI to be a very fast but mediocre programmer. Kind of like giving a beginner access to all the documentation and a time machine. Sometimes that's exactly what you want. But definitely not most of the time.