Code

Add ReFT (LoReFT, NoReFT, DiReFT)#705

Code

Merged

calpt merged 20 commits intoadapter-hub:mainadapter-hub/adapters:mainfrom calpt:dev/reftcalpt/adapters:dev/reftCopy head branch name to clipboardJul 1, 2024

+616-315

Commits

Commits on May 25, 2024

• WIP reft

  calpt

  committed
  e6f004a

  Copy full SHA for e6f004a

Commits on May 31, 2024

• First working version

  calpt

  committed
  29c32f4

  Copy full SHA for 29c32f4

• Add DiReft support

  calpt

  committed
  25f1d1c

  Copy full SHA for 25f1d1c

Commits on Jun 1, 2024

• Minor hook fix

  calpt

  committed
  beb1280

  Copy full SHA for beb1280

• Fix saving reft orthogonal layers with safetensors

  calpt

  committed
  d74eee5

  Copy full SHA for d74eee5

• Start adding docs

  calpt

  committed
  b041b46

  Copy full SHA for b041b46

Commits on Jun 3, 2024

• Add method description docs

  calpt

  committed
  4ab4069

  Copy full SHA for 4ab4069

• ReFT

  calpt

  committed
  1cd81a8

  Copy full SHA for 1cd81a8

Commits on Jun 6, 2024

• Remove redundant orthogonal init

  calpt

  committed
  1eaa863

  Copy full SHA for 1eaa863

Commits on Jun 8, 2024

• Fix CLIP Reft

  calpt

  committed
  6c19ea0

  Copy full SHA for 6c19ea0

• Fix review issues

  calpt

  committed
  f94dbeb

  Copy full SHA for f94dbeb

Commits on Jun 13, 2024

• Support left padding

  calpt

  committed
  baf4dfe

  Copy full SHA for baf4dfe

• test fix

  calpt

  committed
  a798c41

  Copy full SHA for a798c41

Commits on Jun 20, 2024

• Revert left padding

  calpt

  committed
  db7f950

  Copy full SHA for db7f950

Commits on Jun 22, 2024

• Apply suggestions from code review

  Show description for 52b1978
  

  calpt

  and

  lenglaender

  authored
  52b1978

  Copy full SHA for 52b1978

• Remove default implementations from adapter layer classes

  calpt

  committed
  d519a3a

  Copy full SHA for d519a3a

• Merge branch 'main' into dev/reft

  calpt

  authored
  2f26970

  Copy full SHA for 2f26970

• Reft gather/ scatter improvements

  calpt

  committed
  5f2b712

  Copy full SHA for 5f2b712

• Fix for untied weights

  calpt

  committed
  682de00

  Copy full SHA for 682de00

Commits on Jul 1, 2024

• Add location_key to reft

  calpt

  committed
  dcf2f29

  Copy full SHA for dcf2f29