381
Welp ... (ani.social)
submitted 1 month ago by hypertown@ani.social to c/animemes@ani.social
top 29 comments
sorted by: hot top controversial new old
[-] driving_crooner@lemmy.eco.br 71 points 1 month ago

Artistic depiction of AI models training on AI generated data.

[-] 0ops@lemm.ee 44 points 1 month ago

That's a hard-ass album cover

[-] SidewaysHighways@lemmy.world 6 points 1 month ago

Yeah that djents to the max

[-] Hupf@feddit.de 20 points 1 month ago

Least disturbing 40k lore

[-] AllNewTypeFace@leminal.space 43 points 1 month ago

Some have called it the Habsburg Singularity.

[-] GrayBackgroundMusic@lemm.ee 33 points 1 month ago

I'd love for this to be true, but I'd need to see some proof. It feels like wish-fulfillment.

[-] SaucySnake@lemmy.world 48 points 1 month ago

https://arxiv.org/abs/2306.07899 here's a paper that found that one of the biggest sources for LLM training data is corrupted by people using AI to complete the tasks. There are plenty of papers out there that show the effects of this, which they call "model collapse".

[-] FMT99@lemmy.world 15 points 1 month ago

Same. I keep hearing folks mention this but it's not like AI developers aren't aware of this (apart from a bunch of shitty startups that would fail no matter what) One way to deal with it for example is Microsoft is shelling out so much for "pre-AI" datasets (Reddit) but I'm sure there's a lot more of those kinds of initiatives.

Google on the other hand is going to be hard pressed to deal with the ever increasing deluge of AI spam.

[-] Ultraviolet@lemmy.world 26 points 1 month ago

That's a way to deal with it, but in the long term, "pre-AI" becomes a longer and longer time ago, and less and less useful for any practical purposes.

[-] ICastFist@programming.dev 1 points 1 month ago

Google on the other hand is going to be hard pressed to deal with the ever increasing deluge of AI spam.

Given how they're one of the main culprits of showing AI spam on the first page, I don't think they care at all

[-] hypertown@ani.social 5 points 1 month ago

While I don't have definitive proof I've seen both AI fanarts that are so good it's hard to tell if it's AI or not and AI abominations that are so bad and artificial it want to make you puke so I guess it really depends on the model.

Funny enough adobe now offers AI generated stock photos that are closer to those abominations rather than anything good. Though if you think about it AI stock art is so pointless... There are already so many stock photos you can choose from. Why would you go out of your way to choose a photo that looks almost the same as regular stock photos but people have 4 arms in it...

[-] ICastFist@programming.dev 2 points 1 month ago

Why would you go out of your way to choose a photo that looks almost the same as regular stock photos but people have 4 arms in it…

You never know what smut some people are writing. Maybe that 4 armed horror was exactly what they needed for their cover.

[-] Even_Adder@lemmy.dbzer0.com 3 points 1 month ago

I've heard training on synthetic data is fine now. Most datasets are augmented with synthetic data.

[-] zcd@lemmy.ca 32 points 1 month ago* (last edited 1 month ago)

AI "human-centipeding" itself with art and word salads Is going to make confirmed human generated content an extremely valuable resource. That's partly why literally everybody is foaming at the mouth trying to scrape all of our shit. The signal (human) to noise is only going to get worse, The dead Internet is almost here if it isn't already

[-] YourPrivatHater@ani.social 13 points 1 month ago

The feedback loop problem is also a problem for big LLMs. "AI" is a bouble worse than the tulips and NFTs

[-] brucethemoose@lemmy.world 4 points 1 month ago

Its far worse because LLMs are so data hungry. Getting quality data for image diffusion models is not nearly as much of an issue, though still a problem.

[-] YourPrivatHater@ani.social 2 points 1 month ago

You can probably limit the data intake of the image ones pretty good, with LLMs its worse yes. But since the entire shit is a bouble and a environmental catastrophe im happy when they all fail for the better, at least the big ones. The open source guys can still tinker on their hobby of course, maybe some day we get a actual AI that is actually useful.

[-] brucethemoose@lemmy.world 3 points 1 month ago* (last edited 1 month ago)

Nah. I hate to sound bitter/salty, but all the AI haters are just going to fuel OpenAI's crusade/lobbying against open source, and we will be stuck with expensive, inefficient, dumb corporate API models trained on copyrighted material in secret because the corporations literally don't care. And it will do nothing to solve the environmental problems.

There's tons of research on making training and especially inference more power efficient, on making data cleaner and fairer, and it's getting squandered from the lobbying against open source that the "AI is all bad" crowd is fueling. All the money to even turn these experiments into usable models is getting funneled away already.

Everyone's got it wrong, the battle isn't between AI or no AI, it's whether your own it and run it yourself, or big tech owns it and runs it. You know, like Lemmy vs Reddit.

So... that's my rant.

[-] yokonzo@lemmy.world 9 points 1 month ago

I mean we knew about this a couple of years ago no?

[-] webghost0101@sopuli.xyz 9 points 1 month ago* (last edited 1 month ago)

Age of AI: Asset-flip Regenerated

“Death internet theory evolved”

[-] MelodiousFunk@slrpnk.net 7 points 1 month ago

Everybody be worried about Skynet, and I'm all, we need to trudge through Multiplicity first.

[-] AVincentInSpace@pawb.social 6 points 1 month ago

yeah I've seen this before

OP's source is that they want it to be true

[-] mindbleach@sh.itjust.works 3 points 1 month ago

More training has been more important than more input, once they hit critical mass for enough input.

[-] Naz@sh.itjust.works 2 points 1 month ago

Hello, I coined the term "hallucinations" way back in 2019.

I heard "inbreeding" from another author and I've been using that in formal circles and I think it's hilarious.

Yes, we're inbreeding the visual models ;)))))

[-] kogasa@programming.dev 16 points 1 month ago
[-] Naz@sh.itjust.works 2 points 1 month ago

Well shit, look at that, TIL. Nothing is new under the sun.

Still crazy though!

[-] brucethemoose@lemmy.world 2 points 1 month ago* (last edited 1 month ago)

I used the term "inbreeding" even before that, when finetuning ESRGAN on its own output.

That being said, it really isn't as much of a problem for diffusion models as it is for others.

[-] gmtom@lemmy.world 2 points 1 month ago

This is a problem in AI but these people MASSIVELY over state how big of a problem it is because, surprise surprise, the militant anti-AI crows are actually incredibly uneducated on the topic and just parrot the random bullshit they see online because it agrees with their existing beliefs.

[-] leftzero@lemmynsfw.com 0 points 1 month ago

Anyone who played with a photocopier as a kid could have told you this was going to happen.

this post was submitted on 12 Jul 2024
381 points (97.5% liked)

Animemes

1361 readers
2 users here now

Memes related to anime. Animemes.

Rules
  1. Don't be a shithead.
  2. Posts must be a meme with anime or related to anime or weeb culture.
  3. Use NSFW tag for lewd/ecchi. No explicit hentai.
  4. Nothing illegal, copyrighted, etc
  5. Repost only if the last post is 6 months old.

founded 1 year ago
MODERATORS