this post was submitted on 21 Aug 2025
52 points (100.0% liked)

Technology

40038 readers
1 users here now

A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.

Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.

Subcommunities on Beehaw:


This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.

founded 4 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] jimmux@programming.dev 27 points 8 months ago (1 children)

I've done fact checking on LLM models for work before, and it quickly becomes evident that many models rely on Wikipedia as a heavily weighted source of truth.

If LLMs have even a small role in producing Wikipedia content, the ouroborus of declining quality will accelerate.

[–] remington@beehaw.org 10 points 8 months ago (1 children)

I have studied academic biblical scholarship for over 30 years. All of Wikipedia's biblical pages are riddled with errors. IMO, Wikipedia is a decent starting point but that would be it.

[–] hddsx@lemmy.ca 14 points 8 months ago (1 children)

I’d urge you to submit corrections

[–] remington@beehaw.org 12 points 8 months ago (1 children)

My self and others in this field tried for about 6 months to no avail. We gave up...they didn't want to hear it.

[–] theangriestbird@beehaw.org 7 points 8 months ago (1 children)

Can you give an example of an article with an error that you tried to correct? Not trying to cast doubt on your statements, genuinely just curious what kind of roadblocks you hit. I'm no Wikipedia expert, but I have started to dip my toe into editing in recent months.

[–] remington@beehaw.org 15 points 8 months ago (1 children)

Can you give an example of an article with an error that you tried to correct?

This was 6 years ago so I cannot recall precisely which pages. However, I just skimmed over about 15 pages that I thought would be riddled with errors. To my surprise, I only found one instance where there was a 'citation needed' mark and could find no major errors...maybe a few little splitting hairs examples but nothing serious.

So, it appears that improvements have been made over the past 6 years. On the other hand, I only looked over roughly 15 pages.

Probably the same caution would be true for any encyclopedia. Namely, these can be pretty good starting points but not for serious scholarly research.

[–] theangriestbird@beehaw.org 2 points 8 months ago (1 children)

that's cool of you to give it even that brief review! At the end of the day, we 100% agree - Wikipedia is best for surface-level research. But that is what I love it for! Because of Wikipedia, we can all be surface-level experts on almost any topic in minutes. One of the few treasures of living in the 21st century.

[–] remington@beehaw.org 2 points 8 months ago* (last edited 8 months ago)

I agree. I grew up using hard copy encyclopedias at libraries. It is incredible now to have all of this at our fingertips at home.