CriticOPD: Critique-Guided On-Policy Distillation for LLMs
This paper proposes CriticOPD to address teacher recoverability failures during on-policy distillation of language models.
This paper proposes CriticOPD to address teacher recoverability failures during on-policy distillation of language models.