logoalt Hacker News

nickalaso • yesterday at 9:55 PM • 1 reply • view on HN

(Credit to u/yewenjie for source)> Our first formalization of Fermat’s Last Theorem, performed by an unreleased research version of Claude, took 11 days. It relied on a purpose-built harness along with guidance from a human researcher. By contrast, a team of 1,000 Fable 5.2 agents fully formalized the theorem in just 30 hours, with minimal human intervention. Fable 5.2 started from minimal prompts, built its own ways to coordinate, and used no mathematical references, only a list of intermediate theorem statements to score progress. It needed one-third of the action tokens as our first formalization and produced a proof seven times shorter. As can be seen in the figure below, Opus 5.5 (with the same 1,000-agent setup) completed only 26% of the formalization in 18 hours, and barely made any more progress after 30.

I would imagine Anthropic is hitting a wall on the number of simultaneous agents that can be useful on a task and are working on increasing that maximum. I would assume if they could get twice as much progress by using 10000 simultaneous running fable instances instead, their brief would state that.

IMO, it is very interesting and also very alarming. At some point the barrier to the exponential progress is the amount of computation available. The average human is limited in the number of 'human instances' he or she can interface with at one time.

if 1000 fable instances is better than any human at a task, how about 1 million instances running? Much easier than finding and hiring and coordinating 1000 extremely productive and intelligent human beings. Much cheaper too, it appears.

We are very close to some very scary things happening. I just recently came to terms with the fact that an AI could code and manage coders faster and better than me, I don't think anyones is ready for what is about to happen.


Replies

ETH_start • today at 4:54 AM

These companies are not developing AI that can replace humans. What AI is being designed for is to fulfil discrete tasks. This is a far cry from acting as an independent economic actor. The latter is something no company wants to develop, because it is dangerous and not suited for something that is meant to be used as a tool (it is actually unethical to bind an independent actor to labor for us).

More broadly, what distinguishes humans from AI is what makes humans dangerous. Our society tolerates the danger humans pose, as it's considered a prerequisite for a free society. But our society would never tolerate this danger from a tool.

➕ show 1 reply