Cybersecurity

That cloudflare blog post already spilled the beans: it's just unreliable. The same task could be repeated three times and come up with three different answers, sometimes refusing outright, sometimes failing, sometimes returning false positives. Only a fraction of runs turned out anything useful, and that's only after running a separate instance of mythos to sort through the trash, and then multiple more verification runs.

So, the most expensive model, burning the most tokens, you still need two instances and multiple runs through the same underlying task, and it may give you an exploitable bug. My understanding from cloudflare's blog post is that their complex harness is entirely in-house, so I really think most of anthropic's partners are having an even worse experience sorting through mythos trash.

My feeling is that there is a diminishing rate of return on token burn rate. I also believe increasing the complexity of models makes it harder to set boundaries and control output.

Also, most of the bugs so far have come down to not using basic OS safeguards or the attacker already having access to your computer. They are important threat vectors that need to be addressed, but they are types of vulnerabilities we've known about for decades and built protections around.