[`KTOTrainer`] add BCO (reward shift and underlying distribution matching)#1599

Merged

younesbelkada merged 11 commits intohuggingface:mainfrom seanexp:unpaired_bco

Apr 30, 2024

+564-23

Commits on Apr 29, 2024