[-] imadabouzu@awful.systems 8 points 2 months ago

I feel this shouldn't at all be surprising, and continues to point to Diverse Intelligence as more fundamental than any sort General Intelligence conceptually. There's a huge difference between what something is in theory or in principal capable of, and the economics story of what that thing attends to naturally as per its energy story.

Broadly, even simple things are powerful precisely because of what they don't bother trying to do until perturbed.

Ultimately, I hypothesize the reason why VCs like the idea of LLMs doing simple things far more expensively than otherwise is already possible, is because, They literally can't imagine what else to spend their money on. They are vacuous consumers by design.

[-] imadabouzu@awful.systems 7 points 2 months ago

When it comes to cloning or copying, I always have to remind people: at least half of what you are today, is the environment of today. And your clone X time in the future won't and can't have that.

The same thing is likely for these models. Inflate them again 100 years in the future, and maybe they're interesting for inspecting as a historical artifact, but most certainly they wouldn't be used the same way as they had been here and how. It'd just, be something different.

Which would beg the question, why?

I feel like a subset of sci-fi and philosophical meandering really is just increasingly convoluted paths of trying to avoid or come to terms with death as a possibly necessary component of life.

[-] imadabouzu@awful.systems 8 points 3 months ago* (last edited 3 months ago)

The issue isn't even that AI is doing grading, really. There are worlds where using technology to assist in grading isn't a loss for a student.

The issue is that all of this is as an excuse not to invest in students at all and the turn here is purely a symptom of that. Because in a world where we invest in technology to assist in education, the first thing that happens is we recognize the completely unsexy and obvious things that also need to happen, like funding for maintenance of school buildings, basic supplies, balancing class sizes by hiring and redistricting, you know. The obvious shit.

But those things don't attract the attention of the debt metabolism, they're too obvious and don't include more leverage for short term futures. To believe there is a future for the next generation is risk inherent and ambiguous. You can only invest in that it if you actually care.

[-] imadabouzu@awful.systems 8 points 3 months ago

Procreate is an example of what good AI deployment looks like. They do use technology, and even machine learning, but they do it in obviously constructive scopes between where the artist's attention is focused. And they're committed to that because... there's no value for them to just be a thin wrapper on an already completely commoditized technology on its way to the courtroom to be challenged by landmark rulings with no more room ceiling to grow into whooooooops.

[-] imadabouzu@awful.systems 8 points 3 months ago

No joke but actually yes?

[-] imadabouzu@awful.systems 9 points 3 months ago

It can be both. Like, probably OpenAI is kind of hoping that this story becomes wide and is taken seriously, and has no problem suggesting implicitly and explicitly that their employee's stocks are tied to how scared everyone is.

Remember when Altman almost got outed and people got pressured not to walk? That their options were at risk?

Strange hysteria like this doesn't need just one reason. It just needs an input dependency and ambiguity, the rest takes of itself.

[-] imadabouzu@awful.systems 8 points 3 months ago

Short story: it's smoke and mirrors.

Longer story: This is now how software releases work I guess. Alot is running on open ai's anticipated release of GPT 5. They have to keep promising enormous leaps in capability because everyone else has caught up and there's no more training data. So the next trick is that for their next batch of models they have "solved" various problems that people say you can't solve with LLMs, and they are going to be massively better without needing more data.

But, as someone with insider info, it's all smoke and mirrors.

The model that "solved" structured data is emperically worse at other tasks as a result, and I imagine the solution basically just looks like polling multiple response until the parser validates on the other end (so basically it's a price optimization afaik).

The next large model launching with the new Q* change tomorrow is "approaching agi because it can now reliably count letters" but actually it's still just agents (Q* looks to be just a cost optimization of agents on the backend, that's basically it), because the only way it can count letters is that it invokes agents and tool use to write a python program and feed the text into that. Basically, it is all the things that already exist independently but wrapped up together. Interestingly, they're so confident in this model that they don't run the resulting python themselves. It's still up to you or one of those LLM wrapper companies to execute the likely broken from time to time code to um... checks notes count the number of letters in a sentence.

But, by rearranging what already exists and claiming it solved the fundamental issues, OpenAI can claim exponential progress, terrify investors into blowing more money into the ecosystem, and make true believers lose their mind.

Expect more of this around GPT-5 which they promise "Is so scary they can't release it until after the elections". My guess? It's nothing different, but they have to create a story so that true believers will see it as something different.

[-] imadabouzu@awful.systems 8 points 3 months ago

The weird thing, is. From my perspective. Nearly every, weird, cringy, niche internet addiction I've ever seen or partaken in myself, has produced both two things: people who live through it and their perspective widens, and people who don't.

Like, I look back at my days of spending 2 days at a time binge playing World of Warcraft with a deep sense of cringe but also a smirk because I survived and I self regulated, and honestly. Made a couple of lifetime friends. Like whatever response we have to anime waifus, I hope we still recognize the humanity in being a thing that wants to be entertained or satisfied.

[-] imadabouzu@awful.systems 9 points 3 months ago

Watching this election has been amazing! LIKE WOAH what a fucking obviously self destructive end to delusion. Can I be optimistic and hope that with EA leaning explicitly heavier into the hard right Trump position, when it collapses and Harris takes it, maybe some of them will self reflective on what the hell they think "Effective" means anyways.

[-] imadabouzu@awful.systems 9 points 3 months ago* (last edited 3 months ago)

Audacious and Absurd Defender of Humanity

Your honor, I'd rather plea guilty than abide by my audacious counsel.

[-] imadabouzu@awful.systems 8 points 3 months ago

A certain class of idealists definitely feel this way, and it's why many decentralized efforts are fragile and fall apart. Because they can't meaningfully construct something without centralization or owners, they end up just hiding these things under a blanket rather than acknowledging them as design elements that require an intentional specification.

[-] imadabouzu@awful.systems 7 points 4 months ago

I appreciate this perspective, especially

There’s no magic barrier between internalized and externalized cognition.

I think it's increasingly clear that cognition is networking, and no matter how you are constructed, it's both internal and external, and that in a sense, the objects aren't the important thing (the relationships are).

Like, maybe there aren't shortcuts. If you want perfect GO play you may very well have to pay the full inductive price. And even then, congrats, but GO still exists.

It's interesting to see how Chess has continued to be relevant, hell, possibly even more popular than its ever been, due to increased accessibility, alternative formats, and embracing the performance aspects of the game.

view more: ‹ prev next ›

imadabouzu

joined 4 months ago