Code

Add loss like Rho-1#260

Code

Open

GeorgiosSmyrnis wants to merge 4 commits intomainmlfoundations/open_lm:mainfrom gsmyrnis/rho1mlfoundations/open_lm:gsmyrnis/rho1Copy head branch name to clipboard

+85-5

Commits

Commits on Apr 25, 2024

• Add parameters for rho1.

  GeorgiosSmyrnis

  committed
  be6a10e

  Copy full SHA for be6a10e

Commits on Apr 26, 2024

• Add loss calculation like rho1.

  GeorgiosSmyrnis

  committed
  2f20b17

  Copy full SHA for 2f20b17

Commits on Apr 27, 2024

• Fix shapes.

  GeorgiosSmyrnis

  committed
  9d43240

  Copy full SHA for 9d43240

Commits on Apr 29, 2024

• Fixes

  GeorgiosSmyrnis

  committed
  4eec876

  Copy full SHA for 4eec876