This kind of thing is a fluff piece, meant to be suggestive but ultimately saying nothing at all. There are many reasons to hate Bostrom, just read his words, but this is two philosophers who apparently need attention because they have nothing useful to say. All of Bostrom's points here could be summed up as "don't piss on things, generally speaking."

As for consciousness. Honestly, my brain turns off instantly when someone tries to make any point about consciousness. Seriously though, does anyone actually use the category of "conscious / unconscious" to make any decision?

I don't disrespect the dead (not conscious). I don't bother animals or insects when I have no business with them (conscious maybe not conscious?). I don't treat my furniture or clothes like shit, and am generally pleased they exist. (not conscious). When encountering something new or unusual, I just ask myself, "is it going to bite me?" first. (consciousness is irrelevant) I know some of my actions do harm either directly or indirectly to other things, such as eating, or consuming, or making mistakes, or being. But I don't assume myself a hero or arbiter of moral integrity, I merely acknowledge and do what I can. Again, consciousness kind of irrelevant.

Does anyone run consciousness litmus tests on their friends or associates first before interacting, ever? If so, does it sting?

Oh man, anyone who runs on such existential maximalism has such infinite power to state things as if their conclusion has only one possible meaning.

How about invoking Monkey Paw -- what if every statement is true but just not in the way they think.

1. A perfect memory which is infinitely copyable and scaleable is possible. And it's called, all the things in nature in sum.
2. In fact, we're already there today, because it is, quite literally the sum of nature. The question for tomorrow is, "so like, what else is possible?"
3. And it might not even have to try or do anything at all, especially if we don't bother to save ourselves from ecological disaster.
4. What we don't know can literally be anything. That's why it's important not to project fantasy, but to conserve of the fragile beauty of what you have, regardless of whether things will "one day fall apart". Death and Taxes mate.

And yud can both one day technically right and whose interpretations today are dumb and worthy of mockery.

Maybe I'm old fashioned but,

I still start by asking someone who knows about the thing what books they might recommend. And I know mushrooms are especially problematic, so I go look for um, active communities of people who aren't dead from eating the wrong mushrooms.

Is it possible, that we're looking too far away from accountable sources when we route our knowledge searches through noisy corporate slops?

LLM, tell me the most obviously persuasive sort of science devoid of context. Historically, that's been super helpful so let's do more of that.

I'm so happy for appends. ~and edits~

It can be both. Like, probably OpenAI is kind of hoping that this story becomes wide and is taken seriously, and has no problem suggesting implicitly and explicitly that their employee's stocks are tied to how scared everyone is.

Remember when Altman almost got outed and people got pressured not to walk? That their options were at risk?

Strange hysteria like this doesn't need just one reason. It just needs an input dependency and ambiguity, the rest takes of itself.

Watching this election has been amazing! LIKE WOAH what a fucking obviously self destructive end to delusion. Can I be optimistic and hope that with EA leaning explicitly heavier into the hard right Trump position, when it collapses and Harris takes it, maybe some of them will self reflective on what the hell they think "Effective" means anyways.

Audacious and Absurd Defender of Humanity

Your honor, I'd rather plea guilty than abide by my audacious counsel.

I'm ok with this because everytime Nick Bostrom's name is used publicly to defend anything, and then I show people what Nick Bostrom believes and writes, I robustly get a, "What the fuck is this shit? And these people are associated with him? Fuck that."

It can't stop the usage, it can raise the cost of doing so, by bringing in legal risk of operations operating in a public way. It can create precedence that can be built upon by other parts.

Politics and law move slower than and behind the things it attempts to regulate by design. Which is good, the atlernative is a surveilance state! But it definitely can arrange itself to punish or raise the risk profile of doing something in a certain patterned way.

Kurzgesagt

Yeah I'm not surprised. Kurzgesagt has always had that sort of forced, fragile, veneer of optimism and scientific inquiry that can only be described as "all I can imagine about the future I read about in the 60s".

Why so general? The multi-agent dynamical systems theory needed to heal internal conflicts such as auto-immune disorders may not be so different from those needed to heal external conflicts as well, including breakdowns in social and political systems.

This isn't, an answer to the question why so general? This is aspirational philosophical goo. "multi-agent dynamical systems theory" => you mean any theory that takes composite view of a larger system? Like Chemistry? Biology?Physics? Sociology? Economics? "Why so general" may as well be "why so uncommitted?"

I feel bayesian rationalism has basically missed the point of inference and immediately fallen into the regression to the mean trap of "the general answer to any question shouldn't say anything in particular at all."