Mixed-policy preference optimization with self-generated non-preferred responses and off-policy preference distillation

Binrui Wang, Zikai Wang, Yongping Du, Mingyang Li. Mixed-policy preference optimization with self-generated non-preferred responses and off-policy preference distillation. Neurocomputing, 695:133996, 2026. [doi]

Abstract

Abstract is missing.