Recursive self-improvement (RSI) is the idea that an AI system can make itself better, and that each improved version can then do a better job of improving the next one. As of October 2026, the published evidence does not show an AI that improves without limit. It shows something narrower but still interesting: models raising their scores on specific tasks over a few rounds, inside loops that humans designed. This guide walks through two preprints posted to arXiv on October 8 and 9, 2026, MASS from Sakana AI and UC Berkeley and RSI-Anything, and explains what actually improved and what did not.

What recursive self-improvement means

The Wikipedia overview defines RSI as a process in which an AI system iteratively designs a more capable successor, and links it to the hypothesis of an intelligence explosion. The key word is recursive. It is not a single upgrade. The output of one improvement step becomes the tool for the next step, and the loop keeps running.

Researchers usually split that loop into three jobs. The optimizee does the task. The optimizer changes how the task is done. The evaluator decides whether the new result is better. When one model fills all three roles, the MASS authors call it homogeneous RSI. It removes the need for a human answer key, but it also means a mistaken judge can steer the whole system in the wrong direction.

An earlier, narrower example: AlphaEvolve

Google DeepMind announced AlphaEvolve on May 14, 2025. It found a way to split a matrix multiplication kernel that sped it up by 23% inside Gemini's architecture, cutting Gemini training time by 1%, including for the models that power AlphaEvolve itself. The catch is that AlphaEvolve relies on automated evaluators that can verify answers, which suits math and computing but not open-ended work like research reports.

Sakana AI's MASS: learning from a team of copies

MASS (Multi-Agent Self-Supervision) targets non-verifiable research tasks, where no rule-based grader exists. The same model runs a multi-agent team, judges the team's work, and then trains on the best team runs.

1. 1

   Inner loop: search for a better workflow

   With weights frozen, the model rewrites a written workflow covering each subagent's role, instructions, output contract and call order. If the self-evaluator prefers the new result, it becomes the champion.

2. 2

   Outer loop: train on the best runs

   Each champion workflow runs 18 times per task. The model ranks the results and keeps up to 16 trajectories (15 for training, one for validation), then fine-tunes itself with LoRA after removing the workflow text from the prompt.

3. 3

   Repeat

   The updated model takes over all three roles for the next round.

Starting from Qwen3.6-27B, the team ran two rounds on 12 synthetic research tasks in finance, robotics and pharmacy, with three held out. According to Sakana AI's write-up, the win rate against the base model on held-out tasks rose to 53.9% after round one and 69.9% after round two, as scored by GPT-5.5 and Claude Opus 4.8, which were kept out of the training loop. On MLR-Bench, DSBench, ScienceAgentBench and AstaBench, score per output token reached 1.2x to 1.6x the base model.

Notable findings from MASS

• Role generalization: training only on task-solving runs also improved the optimizer and evaluator. Agreement with external judges rose from 73% to 93% across three cycles.
• The optimizer can be the bottleneck: swapping in GPT-5.5 as evaluator alone found winning workflows for 10 of 12 tasks; upgrading both evaluator and optimizer found all 12 within five iterations. The all-base loop reached 11 of 12 by iteration 13.
• Denser training signal: a model trained on multi-agent runs reached a 68.3% win rate after 28.8M supervised tokens, versus 64.0% after 42M tokens for single-agent runs.

RSI-Anything: using world models to choose what to learn

RSI-Anything, submitted October 9, 2026, starts from two practical problems: outside feedback is expensive, and a world model's predictions drift as the policy changes. Built on JEPA-Anything, it uses predictive world models to choose actions and training data, then keeps an updated policy-model pair only if it passes component and compatibility checks. In other words, not every change is allowed to stick.

The code-repair gain is about five percentage points: a steady improvement from better data selection, not a sudden leap. The lab-planning jump happened across five versions, not in one step.

Limits of recursive self-improvement research today

1. Uneven transfer. MASS scored 0.96x on Terminal-Bench 2.0 and 0.94x on SWE-bench Verified, below the base model on score per output token.
2. Short horizons. MASS reports two rounds and RSI-Anything five policy versions. Nobody has shown the gains keep compounding.
3. Noisy search. The MASS authors note that strong workflow iterations can be followed by sharp regressions.
4. Human scaffolding. Task design, external judges, structural guardrails and retention checks were all set by people.
5. Not yet peer reviewed. Both papers are v1 preprints as of October 2026, so numbers may change after replication.

How to read the next RSI headline

• What changed: model weights, prompts and workflows, or data selection?
• Who judged: the model itself, another model, humans, or an automatic verifier?
• Did it improve on tasks it never trained on?
• Was the compute or experiment budget held constant?
• How many rounds were run before the claim was made?

AI research claims spread quickly and often lose their caveats along the way. To trace where a story started, compare the AI Telegram trends on theddari with the blog trends feed and check each claim against the original paper.

页面引用

趋势theddari.com›趋势Telegram · AIAI 频道实时帖子

页面引用

趋势theddari.com›趋势博客文章经过摘要的 Naver 博客文章