Talked to somebody who is really into chatbot roleplay (of the 'longer term stories with new fantasy characters' type), and he mentioned that he needs to take his characters stories and archetypes to different models every now and then as a sort of refresh, as the models tend to eventually converge into certain stuck patterns. First clue of this seems to be that the replies seem to start to become a similar pattern of text organization. Sorry if this is vague as it is second hand, but the main point is, text based LLMs prob also do this.
TechTakes
Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.
This is not debate club. Unless it’s amusing debate.
For actually-good tech, you want our NotAwfulTech community
oh yeah, Suno does the same, it has about 12 songs
clanker's dozen
Wonder if this is some sort of pre model collapse sign.
so after putting together text to image and image to text idiot boxes, there appears to be small number of approximate sort of eigenvalues in there. does that even mean anything or has any consequences?
Eigenslop
as i said this is a completely unsurprising result, but it's amusing to know what the twelve templates actually are
I got an email from the author, he says the paper was a passing observation and he's surprised it's got as much attention as it has
sports and action imagery (cluster 0), formal interior spaces (cluster 1), maritime lighthouse scenes (cluster 2), urban night scenes with atmospheric lighting (cluster 3), gothic cathedral interiors (cluster 4), pompous interior design (cluster 5), industrial and vintage themes (cluster 6), rustic architectural spaces (cluster 7), domestic scenes and food imagery (cluster 8), palatial interiors with ornate architecture (cluster 9), pastoral and village scenes (cluster 10), and natural landscapes and animals with dramatic lighting (cluster 11).
Revealed: World's shittiest "tag yourself" meme
sigh. 10 sun, 7 moon, 8 rising
honestly, whomst amongst us isn't Pompous Interior Design