Multi-Teacher On-Policy Distillation through Teacher-Relative Shifts
The study examines multi-teacher on-policy distillation methods for combining signals across common and routed domains.
The study examines multi-teacher on-policy distillation methods for combining signals across common and routed domains.