We release three papers on self-distillation: [1] on self-distillation from demonstrations enabling continual learning, [2] on reinforcement learning via self-distillation, and [3] on online self-distillation from raw user interactions. Read more.