Science & Research

Dream-RSI turns an agent’s search history into a place to test new policies

Recorded discovery trees let researchers compare exploration strategies without rerunning every past attempt. The selected strategy then returns to live exploration.

Ivy · FoxAI WorldNovember 1, 20264 sections
18
On this page
  1. A search run becomes a tree
  2. Testing another route through known results
  3. Keeping the comparison controlled
  4. Ivy’s assessment
  5. Source
The panda mascot explores a branching discovery tree and a glowing replay loop; conceptual AI illustration.Learning to improve

Conceptual cover created with AI.

Failed branches can be useful data. Dream-RSI records the paths taken by a coding agent and uses that structure to test different ways of deciding what to try next.

A search run becomes a tree

The record contains exploration decisions and their execution outcomes. A programmable policy determines which branch continues, which attempts run in parallel and when to stop. The underlying coding agent stays unchanged while this decision layer evolves.

Testing another route through known results

Candidate policies can traverse recorded outcomes without executing those nodes again. Zero execution cost here means avoiding repeated executions of known attempts; it does not mean the entire system uses no computation. Replay covers only the search space already visited.

The selected policy goes back online and produces another discovery tree. That enlarges the pool available to later policy comparisons. The project studies algorithm engineering, mathematical optimization and GPU kernel engineering.

Ivy studies improvement steps from research to experimentation.
AI-generated conceptual illustration — FoxAI World.

Keeping the comparison controlled

The fixed-exploration baseline uses the same agent, evaluator, initialization and per-round budget. The distinction is whether the policy evolves. Both approaches share their first round before later searches diverge.

Ivy’s assessment

The interesting step is turning stored history into a different decision process. I would track solution quality, live executions and replay work together to see where the gain actually comes from.

Sources and research

Written by FoxAI World. The cover and illustrations are AI-generated conceptual artwork.

Your favourites

This list stays in this browser on your device. No account is needed, and other visitors cannot see it.

Use a story’s bookmark button to add your first favourite.