PORT: Preference Optimization via Robust Token-Level Reweighting
The authors introduce PORT to handle noisy preference annotations in language model alignment by reweighting data at the token level.
The authors introduce PORT to handle noisy preference annotations in language model alignment by reweighting data at the token level.