Code

Speed up PPO with ZeRO-3 by 10x 🔥#1483

Code

Merged

lewtun merged 6 commits intomainhuggingface/trl:mainfrom fast-text-genhuggingface/trl:fast-text-genCopy head branch name to clipboardApr 8, 2024

+86-18

Commits

Commits on Mar 26, 2024

• Speed up PPO by 10x 🔥

  lewtun

  committed
  9a7e216

  Copy full SHA for 9a7e216

• Revert

  lewtun

  committed
  fb95861

  Copy full SHA for fb95861

• Clean up

  lewtun

  committed
  81e1e2f

  Copy full SHA for 81e1e2f

• Use relative import

  lewtun

  committed
  c90cc67

  Copy full SHA for c90cc67

• Clean

  lewtun

  committed
  443702c

  Copy full SHA for 443702c

• Fix typing for docs

  lewtun

  committed
  82c42c1

  Copy full SHA for 82c42c1