METR recently estimated that Anthropic is now making AI progress about twice as fast as its historical rate (they would not be surprised by anything from 1.3x to 3x), and guessed that “perhaps ≈80%” of the current acceleration is due to AI. If they’re right, that implies an AI-driven acceleration that is 5 months ahead of the AI 2027 scenario.80 precent!
This level of acceleration due to AI is very unexpected. Previously, Daniel, the most bullish of us, assigned a 50% chance of Superhuman AI Researcher (SAR)1 before 2029. SAR is roughly the point at which a company would rather fire all their human researchers and rely solely on automated AI researchers than have a team of the best human researchers in the world with no AIs.2
Now, all of us forecast that Superhuman AI Researcher (SAR) will likely arrive at some point in 2027 (assuming no substantial deliberate slowdown).3 We also predict a 35-65% chance that Top-Expert-Dominating AI (TED-AI), AIs that can automate all white-collar work, will arrive before 2028. While there were many factors and sources of evidence that influenced us, the single biggest source was the METR report.4.
I have to admit that this all seems almost impossible to me, even wildly preposterous. But that surely says more about me than about AI. Lots of people from Silicon Valley are talking about this on social media, and many see it a threat. Even the younger guys right in the middle of everything are sounding scary, and I've always thought that it's the younger guys in any corporation or industry who really know what's going on.
Here is Anthropic co‑founder Christopher Olah's full speech at the launch of Pope Leo XIV’s first encyclical, Magnifica Humanitas: On the Protection of Human Dignity in the Age of Artificial Intelligence, posted 5 months ago. I've started the clip where I think it's most important.
By the way, as of Thursday Forbes estimated Olah's net worth at $14.2 billion.
Here is Anthropic co‑founder Christopher Olah's full speech at the launch of Pope Leo XIV’s first encyclical, Magnifica Humanitas: On the Protection of Human Dignity in the Age of Artificial Intelligence, posted 5 months ago. I've started the clip where I think it's most important.
This does not look good for society. Even if it ultimately works out for humans, there is going to be a decade or two of turmoil, people losing their jobs, not knowing what they will do for money, for food, for shelter. I can't see that as being anything but very ugly and scary.
No comments:
Post a Comment