347
The Fall of Stack Overflow (observablehq.com)
submitted 11 months ago by trashhalo@beehaw.org to c/technology@beehaw.org

Over the past one and a half years, Stack Overflow has lost around 50% of its traffic. This decline is similarly reflected in site usage, with approximately a 50% decrease in the number of questions and answers, as well as the number of votes these posts receive.

The charts below show the usage represented by a moving average of 49 days.


What happened?

top 50 comments
sorted by: hot top controversial new old
[-] Greg@lemmy.ca 158 points 11 months ago

There is a lot of Stack Overflow hate in this thread. I never had a bad experience. I was always on there yelling at noobs, telling them to Google it, and linking to irrelevant questions. It was just wholesome fun that briefly dulled my crippling insecurities

[-] Alto@kbin.social 28 points 11 months ago

So you never had a bad experience, just were actively causing bad experiences for others?

[-] HERRAX@sopuli.xyz 125 points 11 months ago

I think you just fell for quite an obvious case of sarcasm.

[-] outlying_demotion_nemeses 38 points 11 months ago

A "woosh" if you will.

[-] Alto@kbin.social 37 points 11 months ago

Sorry for being autistic ig

load more comments (10 replies)
load more comments (3 replies)
[-] DataDecay@beehaw.org 139 points 11 months ago

Rather than cultivate a friendly and open community, they decided to be hostile and closed. I am not surprised by this at all, but I am surprised with how long the decline has taken. I have a number of bad/silly experiences on stackoverflow that have never been replicated on any other platform.

load more comments (5 replies)
[-] orsetto@beehaw.org 94 points 11 months ago

All questions have been asked and all answers have been given

[-] focus@lemmy.film 46 points 11 months ago

and copilot and chatgpt give good enough answers without being unfriendly

[-] bionicjoey@lemmy.ca 47 points 11 months ago

ChatGPT has no knowledge of the answers it gives. It is simply a text completion algorithm. It is fundamentally the same as the thing above your phone keyboard that suggests words as you type, just with much more training data.

[-] Barbarian772@feddit.de 42 points 11 months ago

Who cares? It still gives me the answers i am looking for.

[-] bionicjoey@lemmy.ca 26 points 11 months ago

Yeah it gives you the answers you ask it to give you. It doesn't matter if they are true or not, only if they look like the thing you're looking for.

load more comments (22 replies)
load more comments (4 replies)
[-] blueson@feddit.nu 22 points 11 months ago

I honestly believe people are way overvaluing the responses ChatGPT gives.

For a lot of boilerplating scenarios or trying to resolve some pretty standard stuff, it's good.

I had an issue a while back with QueryDSL running towards an MSSQL instance, which I tried resolving by asking ChatGPT some pretty straightforward questions regarding the tool. Without going too much into detail, I basically got stuck in a loop where ChatGPT kept suggesting solutions that were not viable at all in QueryDSL. I pointed it out, trying to point out why what it did was wrong and it tried correcting itself suggesting the same broken solutions.

The AI is great until whatever it has been taught previously doesn't cover your situation. My solution was a bit of digging in google away, which helpfully made me resolve the issue. But had I been stuck with only ChatGPT I'd still be going around in loops.

load more comments (3 replies)
load more comments (8 replies)
load more comments (1 replies)
[-] AAA@feddit.de 88 points 11 months ago

Amazing how much hate SO receives here. As knowledge base it's working super good. And yes, a lot of questions have been answered already. And also yes, just like any other online community there's bad apples which you have to live with unfortunately.

Idolizing ChatGPT as a viable replacementis laughable, because it has no knowledge, no understanding, of what it says. It's just repeating what it "learned" and connected. Ask about something new and it will simply lie, which is arguably worse than an unfriendly answer in my opinion.

[-] SkepticElliptic@beehaw.org 27 points 11 months ago

The advice on stack overflow is trash because "that question has been answered already" yeah, it was answered 10 years ago on a completely different version. That answer is depreciated.

Not to mention the amount of convoluted answers that get voted to the top and then someone with two upvotes at the bottom meekly giving the answer that you actually needed.

It's like that librarian from the New York public library who determined whether or not children's books would even get published.

She gave "good night moon" a bad score and it fell out of popularity for 30 years after the author died.

load more comments (2 replies)
[-] avidamoeba@lemmy.ca 18 points 11 months ago* (last edited 11 months ago)

Explains the huge swaths of bad advice shared on Reddit though. It's shared confidently and with a smile. Positive vibes only!

load more comments (1 replies)
load more comments (5 replies)
[-] Blackmist@feddit.uk 79 points 11 months ago

I think the issue is how people got to Stack Overflow. People generally ask Google first, which hopefully would take you somewhere where somebody has already asked your question and it has answers.

Type a technical question into Google. Back in the day it would likely take you to Experts Exchange. Couple of years later it would take you to Stack Overflow. Now it takes you to some AI generated bullshit that scraped something that might have contained an answer, but was probably just more AI generated bullshit.

Either their SEO game is weak, they stopped paying Google as much for result placement, or they've just been overwhelmed with limitless nonsense made by bots for the sole purpose of selling advertising space that other bots will look at.

Or maybe I'm wrong and everybody is just asking ChatGPT their technical questions now, in which case god fucking help us all...

load more comments (2 replies)
[-] pglpm@lemmy.ca 60 points 11 months ago* (last edited 11 months ago)

Understandably, it has become an increasingly hostile or apatic environment over the years. If one checks questions from 10 years ago or so, one generally sees people eager to help one another.

Now they often expect you to have searched through possibly thousands of questions before you ask one, and immediately accuse you if you missed some – which is unfair, because a non-expert can often miss the connection between two questions phrased slightly differently.

On top of that, some of those questions and their answers are years old, so one wonders if their answers still apply. Often they don't. But again it feels like you're expected to know whether they still apply, as if you were an expert.

Of course it isn't all like that, there are still kind and helpful people there. It's just a statistical trend.

Possibly the site should implement an archival policy, where questions and answers are deleted or archived after a couple of years or so.

[-] tburkhol@beehaw.org 41 points 11 months ago

human nature remembers negative experiences much better than positive, so it only takes like 5% assholes before it feels like everyone is toxic.

load more comments (1 replies)
[-] Barbarian772@feddit.de 33 points 11 months ago

The worst is when you actually read all that questions and clearly stated how they don't apply and that you already tried them and a mod is still closing your question as a duplicate.

[-] Sabata11792@kbin.social 25 points 11 months ago

I can't wait to read gems like "Answered 12/21/2005 you moron. Learn to search the website. No, I wont link it for you, this is not a Q&A website".

load more comments (3 replies)
load more comments (1 replies)
[-] xtremeownage@lemmyonline.com 58 points 11 months ago

Honestly.

Stackoverflow is a horrible place to ask anything.

I have had 100% legit, well documented questions, closed as duplicate of unrelated other question.

Its... honestly, just not a friendly place to go. Full of a bunch of assholes....

Most of the answers actually suck too. Many times, you will find the correct answer downvoted, and incorrect or bad answers upvoted.

load more comments (4 replies)
[-] _xDEADBEEF@lemm.ee 58 points 11 months ago

Google search going to absolute shit is what happened

[-] cOlz@beehaw.org 31 points 11 months ago

I also attribute most of this to google. I am used to google a coding question and getting 10 SO results i can quickly scan through. Since a year I only get blogposts about the general behaviour of the thing i was googling.

[-] avidamoeba@lemmy.ca 20 points 11 months ago

This is the most likely explanation. It doesn't make sense to have such a dramatic dropoff in user behavior without an obvious trigger.

load more comments (1 replies)
[-] voidf1sh@lemm.ee 52 points 11 months ago

SO is such a miserable and toxic place that oftentimes I'd rather read more documentation or reach out to someone elsewhere like Discord. And I would never post a question there or comment there.

[-] DeadlineX@lemm.ee 36 points 11 months ago* (last edited 11 months ago)

I’d rather read the docs than just about anything. I love good documentation. I wanna know how and why things work.

The problem is that basically nobody has good docs. They are almost all either incomplete or unreadable.

[-] RoboRay@kbin.social 19 points 11 months ago* (last edited 11 months ago)

A lot of companies won't employ technical writers, who exist to make good, thorough, complete and well-presented documentation... they rather assume their engineers can just write the docs.

And no, no they can't... very few engineers study the principles of effective communication. They may understand things, but they can't explain them.

load more comments (1 replies)
load more comments (2 replies)
[-] wabafee@lemm.ee 51 points 11 months ago* (last edited 11 months ago)

It's hostile to new users and when you do ask you will likely not get answer might get scolded or just get closed as duplicate. Then there is the fact that most has answers doesn't matter if it's outdated or just bad advice. Pretty much everything has GitHub now. Usually I just go raise the question there if I have a genuine question get an answer from the developers themselves. Or just go to their website api/ library doc they have gotten good lately. Then finally recent addition with chatgpt you can ask just about any stupid question you have and maybe it may give some idea to fix the problem you encounter. Pretty much the ultimate rubber duck buddy.

[-] floppy@rabbitea.rs 49 points 11 months ago
load more comments (1 replies)
[-] DominicO@ttrpg.network 49 points 11 months ago

chatGPT doesn't chastize me like a drill instructor whenever I ask it coding problems.

[-] Quexotic@beehaw.org 35 points 11 months ago

It's funny because if you look at the numbers it looks like traffic started to go down before chat GPT was actually released to the public, indicating that maybe people thought that the site was too much of a pain in the ass to deal with before that and GPT is just the nail in the coffin.

Personally, of all the attempts I've had it positive interactions on that site I've had only one and at this point I treat it as a read-only site because it's not worth my time arguing pedants just to get a question answered.

If I went to the library and all the librarians were assholes I probably wouldn't go to that library anymore either.

[-] jherazob@beehaw.org 19 points 11 months ago

It just invents the answer out of thin air, or worse, it gives you subtle errors you won't notice until you're 20 hours into debugging

load more comments (6 replies)
[-] chaorace 45 points 11 months ago* (last edited 11 months ago)

It's too much to attribute to any one effect. 50% is a lot for a website of this size (don't forget that Lemmy exploded from a migration of <5% Reddit usershare). Let's KISS by attributing likely causes in order of magnitude:

  1. ChatGPT became the world's fastest growing website in a single month and it's actually half-decent at being a code tutor
  2. ChatGPT bots got unleashed on SO and diluted a lot of SO's comparative advantages
  3. Stack Overflow moderators went on strike, which further damaged content quality
  4. Structurally speaking, SO is an environment which tends to become more elitist over time. As the userbase becomes progressively more self-selective, the population shrinks.
  5. The SO format requires a stream of novel questions, but novel questions generally get rarer over time
  6. Developer documentation has generally improved over time. On SO, asking about a well-documented thing is a short-circuit pathway to getting RTFM'd & discussion locked
load more comments (5 replies)
[-] Lmaydev@programming.dev 44 points 11 months ago* (last edited 11 months ago)

In my experience many of the answers have become out of date. It's gradually becoming an archive of the old ways of doing things for many languages / frameworks.

Questions are often closed as a duplicate when the linked question doesn't apply anymore. It's full of really bad ways of doing things.

I'm not really sure of the solution at this point.

Also ChatGPT.

It's a last resort for me nowadays.

load more comments (7 replies)
[-] BurningnnTree@lemmy.one 38 points 11 months ago

Why is everyone saying this is because Stack Overflow is toxic? Clearly the decline in traffic is because of ChatGPT. I can say from personal experience that I've been visiting Stack Overflow way less lately because ChatGPT is a better tool for answering my software development questions.

[-] Rentlar@beehaw.org 20 points 11 months ago

I was going to say ChatGPT.

I think the smugness of StackOverflow is still part of it. Even if ChatGPT sometimes fabricates imaginary code, it's tone is flowery and helpful, compared to the typical pretentiousness of Stackoverflow users.

load more comments (3 replies)
[-] ShrimpsIsBugs@feddit.de 19 points 11 months ago

The timing doesn't really add up though. ChatGPT was published in November 2022. According to the graphs on the website linked, the traffic, the number of posts and the number of votes all already were in a visible downfall and at their lowest value of more than 2 years. And this isn't even considering that ChatGPT took a while to get picked up into the average developer's daily workflow.

Anyhow though, I agree that the rise of ChatGPT most likely amplified StackOverflow's decline.

load more comments (6 replies)
[-] pglpm@lemmy.ca 34 points 11 months ago* (last edited 11 months ago)

One aspect that I've always been unsure about, with Stack Overflow, and even more with sibling sites like Physics Stack Exchange or Cross Validated (stats and probability), is the voting system. In the physics and stats sites, for example, not rarely I saw answers that were accepted and upvoted but actually wrong. The point is that users can end up voting for something that looks right or useful, even if it isn't (probably less the case when it comes to programming?).

Now an obvious reply to this comment is "And how do you know they were wrong, and non-accepted ones right?". That's an excellent question – and that's exactly the point.

In the end the judge about what's correct is only you and your own logical reasoning. In my opinion this kind of sites should get rid of the voting or acceptance system, and simply list the answers, with useful comments and counter-comments under each. When it comes to questions about science and maths, truth is not determined by majority votes or by authorities, but by sound logic and experiment. That's the very basis from which science started. As Galileo put it:

But in the natural sciences, whose conclusions are true and necessary and have nothing to do with human will, one must take care not to place oneself in the defense of error; for here a thousand Demostheneses and a thousand Aristotles would be left in the lurch by every mediocre wit who happened to hit upon the truth for himself.

For example, at some point in history there was probably only one human being on earth who thought "the notion of simultaneity is circular". And at that time point that human being was right, while the majority who thought otherwise were wrong. Our current education system and sites like those reinforce the anti-scientific view that students should study and memorize what "experts" says, and that majorities dictate what's logically correct or not. As Gibson said (1964): "Do we, in our schools and colleges, foster the spirit of inquiry, of skepticism, of adventurous thinking, of acquiring experience and reflecting on it? Or do we place a premium on docility, giving major recognition to the ability of the student to return verbatim in examinations that which he has been fed?"

Alright sorry for the rant and tangent! I feel strongly about this situation.

load more comments (8 replies)
[-] VoxAdActa@beehaw.org 30 points 11 months ago

It couldn't happen to a more deserving group of smug, self-satisfied shitheads.

load more comments (5 replies)
[-] A10@kerala.party 24 points 11 months ago

Tried to answer a question got shutdown by mods immediately. I was wondering how stack overflow is going to survive. I know now it won't.

[-] ipkpjersi@lemmy.one 20 points 11 months ago

I bet Google searching in general has gone down too. It's often times quicker to just ask ChatGPT for an answer, and usually you can tell when an answer is correct or not. It's like the old days of manually searching on Google for StackOverflow questions and then finding answers, and then trying to determine which one will work.

load more comments (2 replies)
[-] Deathcrow@lemmy.ml 19 points 11 months ago

Half of a fuck-ton is still a lot. If they scale down their operational costs they can still run a very comfortable business for a long while on these kinds of numbers.

load more comments (1 replies)
[-] JackbyDev@programming.dev 18 points 11 months ago

Stack Exchange has been making a large number of bad calls over the past few years. Basically pissing off their moderators. The first one was Monica who actually sued them for it (libel or defamation or something, basically they said she was being transphobic or something when she wasn't) and they settled. Around that time, possibly before, they removed a site from their Hot Network Questions because of a single tweet. Combine that with them constantly ignoring Stack Exchange Meta (where users and admins are meant to interact for the better of the site and discuss the sites themselves). Moderators were understandably furious when their posts get ignored in the place where Stack Exchange says they're meant to communicate when a random tweet gets more attention and immediate action.

More recently they've given different instructions privately to moderators than what they said publicly with regards to suspected AI content.

I mean, combine all of that with how hostile the users of the site are. Accusing you of not searching before posting and marking your question as a duplicate because they think it is and refusing to listen to why you say it isn't.

load more comments (2 replies)
load more comments
view more: next ›
this post was submitted on 25 Jul 2023
347 points (100.0% liked)

Technology

37381 readers
258 users here now

Rumors, happenings, and innovations in the technology sphere. If it's technological news or discussion of technology, it probably belongs here.

Subcommunities on Beehaw:


This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.

founded 2 years ago
MODERATORS