Advantage-Based On-Policy Distillation in Language Models
Researchers propose distinguishing between teacher preferences and helpful guidance to improve online policy distillation in language models.
Researchers propose distinguishing between teacher preferences and helpful guidance to improve online policy distillation in language models.