休息室
连接中…
连接中…
查看全部

What Is Recursive Self-Improvement in AI? What New Research Shows and Its Limits

What recursive self-improvement (RSI) in AI means, what Sakana AI's MASS and the RSI-Anything paper actually improved, and where the limits are today.

AI热门阅读约 5 分钟阅读 29发布 更新
目录7 个章节
  1. What recursive self-improvement means
  2. Sakana AI's MASS: learning from a team of copies
  3. RSI-Anything: using world models to choose what to learn
  4. Limits of recursive self-improvement research today
  5. How to read the next RSI headline
  6. 常见问题
  7. 来源与参考资料

核心要点

  • Recursive self-improvement (RSI) is a loop in which an AI system improves itself and the improved version then drives the next round of improvement.
  • Sakana AI and UC Berkeley's MASS uses one model as worker, optimizer and judge; after two rounds its win rate against the base model on held-out tasks reached 69.9% under external judges.
  • RSI-Anything uses predictive world models to pick actions and training data, lifting code-repair success from 26.3% to 31.2% with the coder held fixed.
  • Gains are uneven: MASS scored 0.94x the base model's score per output token on SWE-bench Verified.
  • Both papers are arXiv preprints as of October 2026, and the authors flag shared blind spots in self-judging loops as a core safety risk.

Recursive self-improvement (RSI) is the idea that an AI system can make itself better, and that each improved version can then do a better job of improving the next one. As of October 2026, the published evidence does not show an AI that improves without limit. It shows something narrower but still interesting: models raising their scores on specific tasks over a few rounds, inside loops that humans designed. This guide walks through two preprints posted to arXiv on October 8 and 9, 2026, MASS from Sakana AI and UC Berkeley and RSI-Anything, and explains what actually improved and what did not.

What recursive self-improvement means

The Wikipedia overview defines RSI as a process in which an AI system iteratively designs a more capable successor, and links it to the hypothesis of an intelligence explosion. The key word is recursive. It is not a single upgrade. The output of one improvement step becomes the tool for the next step, and the loop keeps running.

Researchers usually split that loop into three jobs. The optimizee does the task. The optimizer changes how the task is done. The evaluator decides whether the new result is better. When one model fills all three roles, the MASS authors call it homogeneous RSI. It removes the need for a human answer key, but it also means a mistaken judge can steer the whole system in the wrong direction.

Optimizee (worker)

What it does
Produces the actual output
What goes wrong if it fails
Lower-quality work

Optimizer

What it does
Revises the workflow based on feedback
What goes wrong if it fails
Good feedback goes unused

Evaluator (judge)

What it does
Picks the better of two outputs
What goes wrong if it fails
Flawed work is kept as training data

An earlier, narrower example: AlphaEvolve

Google DeepMind announced AlphaEvolve on May 14, 2025. It found a way to split a matrix multiplication kernel that sped it up by 23% inside Gemini's architecture, cutting Gemini training time by 1%, including for the models that power AlphaEvolve itself. The catch is that AlphaEvolve relies on automated evaluators that can verify answers, which suits math and computing but not open-ended work like research reports.

Sakana AI's MASS: learning from a team of copies

MASS (Multi-Agent Self-Supervision) targets non-verifiable research tasks, where no rule-based grader exists. The same model runs a multi-agent team, judges the team's work, and then trains on the best team runs.

  1. 1

    Inner loop: search for a better workflow

    With weights frozen, the model rewrites a written workflow covering each subagent's role, instructions, output contract and call order. If the self-evaluator prefers the new result, it becomes the champion.

  2. 2

    Outer loop: train on the best runs

    Each champion workflow runs 18 times per task. The model ranks the results and keeps up to 16 trajectories (15 for training, one for validation), then fine-tunes itself with LoRA after removing the workflow text from the prompt.

  3. 3

    Repeat

    The updated model takes over all three roles for the next round.

Starting from Qwen3.6-27B, the team ran two rounds on 12 synthetic research tasks in finance, robotics and pharmacy, with three held out. According to Sakana AI's write-up, the win rate against the base model on held-out tasks rose to 53.9% after round one and 69.9% after round two, as scored by GPT-5.5 and Claude Opus 4.8, which were kept out of the training loop. On MLR-Bench, DSBench, ScienceAgentBench and AstaBench, score per output token reached 1.2x to 1.6x the base model.

Notable findings from MASS

  • Role generalization: training only on task-solving runs also improved the optimizer and evaluator. Agreement with external judges rose from 73% to 93% across three cycles.
  • The optimizer can be the bottleneck: swapping in GPT-5.5 as evaluator alone found winning workflows for 10 of 12 tasks; upgrading both evaluator and optimizer found all 12 within five iterations. The all-base loop reached 11 of 12 by iteration 13.
  • Denser training signal: a model trained on multi-agent runs reached a 68.3% win rate after 28.8M supervised tokens, versus 64.0% after 42M tokens for single-agent runs.

RSI-Anything: using world models to choose what to learn

RSI-Anything, submitted October 9, 2026, starts from two practical problems: outside feedback is expensive, and a world model's predictions drift as the policy changes. Built on JEPA-Anything, it uses predictive world models to choose actions and training data, then keeps an updated policy-model pair only if it passes component and compatibility checks. In other words, not every change is allowed to stick.

Code repair (coder fixed)

Comparison
Static verifier vs predictive selection vs world-model adaptation
Reported result
26.3% vs 29.2% vs 31.2% success

GUI tasks

Comparison
Against baseline
Reported result
Higher completion, 39.4% fewer actions on average

Lab planning

Comparison
Five successive policy versions
Reported result
21.80% to 46.01%

Reaction optimization

Comparison
Bayesian optimization, same 40-experiment budget
Reported result
96.15% vs 82.16% mean best yield

The code-repair gain is about five percentage points: a steady improvement from better data selection, not a sudden leap. The lab-planning jump happened across five versions, not in one step.

Limits of recursive self-improvement research today

  1. Uneven transfer. MASS scored 0.96x on Terminal-Bench 2.0 and 0.94x on SWE-bench Verified, below the base model on score per output token.
  2. Short horizons. MASS reports two rounds and RSI-Anything five policy versions. Nobody has shown the gains keep compounding.
  3. Noisy search. The MASS authors note that strong workflow iterations can be followed by sharp regressions.
  4. Human scaffolding. Task design, external judges, structural guardrails and retention checks were all set by people.
  5. Not yet peer reviewed. Both papers are v1 preprints as of October 2026, so numbers may change after replication.

The MASS authors call shared blind spots a possible Achilles' heel of RSI. When one model both produces and grades the work, a flaw can be accepted as an improvement, absorbed into the next model, and reinforced with each round, especially if humans also miss it. Critics raise a related concern about model collapse from training on self-generated data.

How to read the next RSI headline

  • What changed: model weights, prompts and workflows, or data selection?
  • Who judged: the model itself, another model, humans, or an automatic verifier?
  • Did it improve on tasks it never trained on?
  • Was the compute or experiment budget held constant?
  • How many rounds were run before the claim was made?

AI research claims spread quickly and often lose their caveats along the way. To trace where a story started, compare the AI Telegram trends on theddari with the blog trends feed and check each claim against the original paper.

常见问题

What is the difference between recursive self-improvement and normal AI training?
Normal training uses human-made data, labels or reward signals to update a model. In recursive self-improvement, the improved model also takes over parts of the next round, such as choosing training data, judging outputs or redesigning its workflow, so the loop repeats. Current research still runs inside human-designed tasks, guardrails and external evaluations.
Is recursive self-improvement already happening?
In narrow forms, yes. Systems like AlphaEvolve have produced optimizations used in training the models behind them, and MASS shows a model improving over two self-supervised rounds. What has not been shown is open-ended, compounding improvement; the Wikipedia overview, as of October 2026, notes major growth in AI self-coding but no sign of an intelligence explosion.
Could RSI lead to an intelligence explosion?
That is the long-standing hypothesis behind the concept, but today's evidence is incremental gains on specific benchmarks after a few rounds. Critics also argue that repeatedly training on self-generated data can cause model collapse rather than improvement. Whether gains keep compounding, plateau or degrade is an open research question.
Why does it matter who the evaluator is?
If the same model produces and grades the work, a shared blind spot can let flawed results be accepted as improvements and baked into the next version. MASS measured progress with outside judges (GPT-5.5 and Claude Opus 4.8) that were kept out of the training loop, which is one way to check a self-judging system.

来源与参考资料

  1. 1MASS: Recursive self-improvement through collective intelligence (Sakana AI)(在新标签页中打开)pub.sakana.ai
  2. 2arXiv:2610.12176 Recursive Self-Improvement through Multi-Agent Self-Supervision(在新标签页中打开)arxiv.org
  3. 3arXiv:2610.13912 RSI-Anything: Unlocking Recursive Self-Improvement with World Models(在新标签页中打开)arxiv.org
  4. 4Google DeepMind: AlphaEvolve, a Gemini-powered coding agent(在新标签页中打开)deepmind.google
  5. 5Wikipedia: Recursive self-improvement(在新标签页中打开)en.wikipedia.org