this post was submitted on 20 Dec 2025
439 points (98.7% liked)

Technology

77981 readers
3089 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
top 50 comments
sorted by: hot top controversial new old
[–] kindred@lemmy.dbzer0.com 97 points 6 days ago (4 children)

This is by far the largest music metadata database that is publicly available. For comparison, we have 256 million tracks, while others have 50-150 million. Our data is well-annotated: MusicBrainz has 5 million unique ISRCs, while our database has 186 million.

Does this mean the MusicBrainz database will soon go from 5 million to 186 million tracks?

[–] zingo@sh.itjust.works 14 points 5 days ago* (last edited 5 days ago)

That's exactly what I was wondering too.

Acquiring high quality music is already easy enough in most cases.

What I am interested in is the metadata. Accurate tagging of all my files is of high interest.

[–] xploit@lemmy.world 31 points 6 days ago

Asking the real questions here...

[–] exu@feditown.com 20 points 5 days ago

Probably not worth it to store the AI tracks

[–] purplemonkeymad@programming.dev 7 points 5 days ago (5 children)

If I ran mb, I would be cautious importing the data directly. I'm sure Spotify would consider it trade information and go after anyone directly using it. However if a few million people added the tracks with individual edits then it probably won't take too long.

load more comments (5 replies)
[–] arcterus@piefed.blahaj.zone 42 points 5 days ago (6 children)
  1. Over-focus on the most popular artists. There is a long tail of music which only gets preserved when a single person cares enough to share it. And such files are often poorly seeded.
  • We primarily used Spotify’s “popularity” metric to prioritize tracks. View the top 10,000 most popular songs in this HTML file (13.8MB gzipped).
  • For popularity>0, we got close to all tracks on the platform. The quality is the original OGG Vorbis at 160kbit/s. Metadata was added without reencoding the audio (and an archive of diff files is available to reconstruct the original files from Spotify, as well as a metadata file with original hashes and checksums).
  • For popularity=0, we got files representing about half the number of listens (either original or a copy with the same ISRC). The audio is reencoded to OGG Opus at 75kbit/s — sounding the same to most people, but noticeable to an expert.

Perhaps I'm reading this wrong, but is this not a little backwards? Since unpopular music is poorly preserved, shouldn't the focus be on getting the least popular music first?

[–] WolfLink@sh.itjust.works 29 points 5 days ago

Unfortunately if you sort by least popular musicon Spotify, you’ll get nothing but spam

[–] JensSpahnpasta@feddit.org 28 points 5 days ago (2 children)

It depends on what your goal is: If you want to preserve the music that is important to most people or to the era, you should start with the most popular stuff. And Spotify has a big spam problem. Everybody who thinks he is a DJ wants his music to be on there and there is so much AI music flooding the scene. So it does make sense to backup what people are actually listening and not some AI-generated music spam nobody cares about.

[–] arcterus@piefed.blahaj.zone 10 points 5 days ago

I mean, they say earlier that music is actually well-preserved, but it's disproportionately popular music. If the goal is then to preserve everything, I'd expect them to go for stuff that isn't likely to be in some random audiophile's collection or whatever then.

load more comments (1 replies)
[–] Techlos@lemmy.dbzer0.com 5 points 4 days ago

If you want that long tail, bandcamp and soundcloud are better sources. The barrier to entry is low with those, and there's a plethora of small, niche artists just doing their own thing.

For a representative snapshot of music though, it's pretty amazing. It shows what a massive percentage of the planet listens to, preserved hopefully across many seeds, and historians will love shit like this in the future.

[–] UltraMagnus@startrek.website 13 points 5 days ago

The politics of preservation is definitely an interesting one. I suppose one argument in favor of preserving more popular music is that there are going to be fewer popular tracks than unpopular tracks - and they're already at 300TB, which is nothing to sneeze at, especially since it's a third the size of their existing library of ebooks.

load more comments (2 replies)
[–] massive_bereavement@fedia.io 76 points 6 days ago (8 children)

I'll strongly suggest to take out all the cheaply AI generated music from this "back up" and save themselves some space.

[–] AnarchistArtificer@slrpnk.net 19 points 5 days ago (1 children)

I'm not sure how they would go about doing that at scale without also getting some false positives and removing human music too

[–] cheesybuddha@lemmy.world 6 points 5 days ago (1 children)

You could cut off your search around the time AI tracks started to appear. Not sure when that was, maybe 2023. You'd miss a lot of recent stuff, but you'd filter out a lot of spam too

[–] AnarchistArtificer@slrpnk.net 4 points 4 days ago

I see your point, but as you say, there would still be the tradeoff of missing more recent stuff. That might only involve missing a couple of years' worth of stuff now, but AI isn't going away any time soon, so it would mean that there'd be an increasing amount of human made music not being archived; One of the things I like about Anna's archive is that they seem to look at this problem as a long term, informational infrastructure kind of way, so I imagine they wouldn't be keen on stopping the archive at 2023.

It seems they've opted for a different tradeoff instead: lower popularity songs are archived at a lower bitrate, and even the higher popularity stuff has some compression. Some archives go for quality, and thus prioritise high quality FLACs, so Anna's archive are aiming to fulfill a different niche. I can respect that.

load more comments (7 replies)
[–] helpImTrappedOnline@lemmy.world 56 points 6 days ago* (last edited 6 days ago) (3 children)

The data they compiled is really cool.

If reading the chart right, the genera with the most artists is opera.

Even if they didn't have the music files, the analysis on the metadata is insane.

Publicly admitting they are the origin of the torrents is definitely ~~a risky~~ an insane move. I don't think they want Sony going after them, but also fuck Sony for locking art behind shitty contracts that forces these kind of projects to exist.

[–] JensSpahnpasta@feddit.org 31 points 5 days ago (1 children)

Publicly admitting they are the origin of the torrents is definitely a risky an insane move. I don’t think they want Sony going after them

Let's be honest: Everybody is trying to go after Annas Archive. Every book publisher wants to get them, the US government, too and it really doesn't matter if every music publisher wants them also. I hope that they are based in a country where the western systems can't get them

[–] Tangent5280@lemmy.world 5 points 5 days ago

I hope (also assume since it hasn't been taken down yet) it's more of a decentralised deal with servers in many places and backups in every nation under the sun

[–] douglasg14b@lemmy.world 22 points 6 days ago (1 children)

Yeah, it's a wild move admitting that they are the source of pirated content for music here.

We don't need Anna's Archive to go under as a result of Sony going after them because of this....

[–] rainwall@piefed.social 11 points 5 days ago* (last edited 5 days ago)

They have had a dozen or more lawsuits/police actions against them. They are already enemy #1 in piracy terms, so I expect they are okay leaning into it and doing more good for the world.

load more comments (1 replies)
[–] jaschen306@sh.itjust.works 12 points 5 days ago

I guess I gotta donate more to anna

[–] lietuva@lemmy.world 47 points 6 days ago* (last edited 5 days ago) (8 children)

There's definitely gonna be some crazy guy who will put this on their server and stream it to their phones lol

[–] extremeboredom@lemmy.world 23 points 6 days ago
[–] thermal_shock@lemmy.world 7 points 5 days ago

I stream mine through Plexamp. Up to almost 400k tracks.

[–] Agility0971@lemmy.world 7 points 5 days ago (1 children)
load more comments (1 replies)
[–] cheesybuddha@lemmy.world 5 points 5 days ago (1 children)

If I had an extra 300 tb I'd do it.

load more comments (1 replies)
load more comments (4 replies)
[–] JoeKrogan@lemmy.world 7 points 5 days ago

Dont have the space but love to see this. I hope people seed this for a long time

[–] Zachariah@lemmy.world 22 points 6 days ago (4 children)

This is the one thing on Spotify I can’t get elsewhere. Would be nice to have a non transcode copy.

https://open.spotify.com/album/4emoC6C9fCDkWPdTuxN9an

…Like Cologne (Spotify Exclusive)
Queens of the Stone Age
2013 • 3 songs • 14 min 5 sec

[–] archonet@lemy.lol 15 points 6 days ago* (last edited 6 days ago) (5 children)
load more comments (5 replies)
[–] pulsewidth@lemmy.world 7 points 5 days ago (1 children)

Well, since this archive says it contains the original ogg @160kbps for all artists with a popularity >0, it'll be in this collection. Your wait may be over soon.

load more comments (1 replies)
load more comments (2 replies)
[–] nymnympseudonym@piefed.social 13 points 6 days ago (9 children)

Spotify is why I set up a Funkwhale server

load more comments (9 replies)
[–] gtr@programming.dev 11 points 6 days ago* (last edited 6 days ago)

Damn, boy! That's a big ass music collection.

load more comments
view more: next ›