← Back to digest
AI Agents & Research

Pass the Baton: trajectory-relayed on-policy distillation

What's this about?

A distillation method that hands the rollout between teacher and student mid-trajectory, so the student learns on-policy from the states it actually visits rather than only from teacher-generated ones.

Why it matters

On-policy distribution mismatch is a classic failure mode; relaying the trajectory (24 upvotes) is a clean idea for training better small models from large ones.

← ReDesign: recovering editable design from imagesCAST: game solvers as turn-level teachers →