Compute Efficiency of Strong-to-Weak OPD against GRPO
This research systematically compares reverse-KL on-policy distillation with Group Relative Policy Optimization across various tasks and model sizes.
This research systematically compares reverse-KL on-policy distillation with Group Relative Policy Optimization across various tasks and model sizes.