Code

[DPO] IPO Training loss#1022

Code

Merged

lvwerra merged 9 commits intohuggingface:mainhuggingface/trl:mainfrom kashif:ipokashif/trl:ipoCopy head branch name to clipboardNov 24, 2023

+48-8

Commits

Commits on Nov 22, 2023

• initial IPO loss

  kashif

  committed
  2899163

  Copy full SHA for 2899163

• fix loss

  kashif

  committed
  0dc4d27

  Copy full SHA for 0dc4d27

• fixed comments

  kashif

  committed
  52befc3

  Copy full SHA for 52befc3

• added docs

  kashif

  committed
  195d1f6

  Copy full SHA for 195d1f6

• fix doc-strings

  kashif

  committed
  ed4147c

  Copy full SHA for ed4147c

• add tests

  kashif

  committed
  9dacd07

  Copy full SHA for 9dacd07

Commits on Nov 23, 2023

• Update trl/trainer/dpo_trainer.py

  Show description for 1caa27f
  

  kashif

  and

  lvwerra

  authored
  1caa27f

  Copy full SHA for 1caa27f

• fixes for review

  kashif

  committed
  8410b2d

  Copy full SHA for 8410b2d

• Added doc about beta in the Trainer's docstring

  kashif

  committed
  de476f0

  Copy full SHA for de476f0