Code

Module Group Offloading#10503

Code

Open

a-r-r-o-w wants to merge 50 commits intomainhuggingface/diffusers:mainfrom groupwise-offloadinghuggingface/diffusers:groupwise-offloadingCopy head branch name to clipboard

+1,239-4

Commits

Commits on Jan 9, 2025

• update

  a-r-r-o-w

  committed
  d1737e3

  Copy full SHA for d1737e3

• fix

  a-r-r-o-w

  committed
  2783669

  Copy full SHA for 2783669

Commits on Jan 10, 2025

• non_blocking; handle parameters and buffers

  a-r-r-o-w

  committed
  6a9a3e5

  Copy full SHA for 6a9a3e5

• update

  a-r-r-o-w

  committed
  c426a34

  Copy full SHA for c426a34

Commits on Jan 11, 2025

• Group offloading with cuda stream prefetching (#10516)

  Show description for d579037
  a-r-r-o-w

  authored
  d579037

  Copy full SHA for d579037

• Merge branch 'main' into groupwise-offloading

  a-r-r-o-w

  authored
  5f33621

  Copy full SHA for 5f33621

Commits on Jan 12, 2025

• update

  a-r-r-o-w

  committed
  a8eabd0

  Copy full SHA for a8eabd0

Commits on Jan 16, 2025

• Merge branch 'main' into groupwise-offloading

  a-r-r-o-w

  committed
  deda9a3

  Copy full SHA for deda9a3

• copy model hook implementation from pab

  a-r-r-o-w

  committed
  80ac5a7

  Copy full SHA for 80ac5a7

• update; ~very workaround based implementation but it seems to work as expected; needs cleanup and rewrite

  a-r-r-o-w

  committed
  d2a2981

  Copy full SHA for d2a2981

• more workarounds to make it actually work

  a-r-r-o-w

  committed
  01c7d22

  Copy full SHA for 01c7d22

• cleanup

  a-r-r-o-w

  committed
  22aff34

  Copy full SHA for 22aff34

Commits on Jan 17, 2025

• rewrite

  a-r-r-o-w

  committed
  42bc19b

  Copy full SHA for 42bc19b

Commits on Jan 19, 2025

• update

  a-r-r-o-w

  committed
  8c63bf5

  Copy full SHA for 8c63bf5

• make sure to sync current stream before overwriting with pinned params

  Show description for e09e716
  a-r-r-o-w

  committed
  e09e716

  Copy full SHA for e09e716

• Merge branch 'main' into groupwise-offloading

  a-r-r-o-w

  authored
  bf379c1

  Copy full SHA for bf379c1

• better check

  a-r-r-o-w

  committed
  0bf0baf

  Copy full SHA for 0bf0baf

Commits on Jan 20, 2025

• update

  a-r-r-o-w

  committed
  b850c75

  Copy full SHA for b850c75

Commits on Jan 23, 2025

• remove hook implementation to not deal with merge conflict

  a-r-r-o-w

  committed
  6ed9c2f

  Copy full SHA for 6ed9c2f

• Merge branch 'main' into groupwise-offloading

  a-r-r-o-w

  committed
  13dd337

  Copy full SHA for 13dd337

• re-add hook changes

  a-r-r-o-w

  committed
  073d4bc

  Copy full SHA for 073d4bc

• why use more memory when less memory do trick

  a-r-r-o-w

  committed
  8ba2bda

  Copy full SHA for 8ba2bda

• why still use slightly more memory when less memory do trick

  a-r-r-o-w

  committed
  b2e838f

  Copy full SHA for b2e838f

• Merge branch 'main' into groupwise-offloading

  a-r-r-o-w

  authored
  f30c55f

  Copy full SHA for f30c55f

Commits on Jan 26, 2025

• optimise

  a-r-r-o-w

  committed
  5ea3d8a

  Copy full SHA for 5ea3d8a

• add model tests

  a-r-r-o-w

  committed
  db2fd3b

  Copy full SHA for db2fd3b

• add pipeline tests

  a-r-r-o-w

  committed
  a0160e1

  Copy full SHA for a0160e1

• update docs

  a-r-r-o-w

  committed
  aaa9a53

  Copy full SHA for aaa9a53

• Merge branch 'main' into groupwise-offloading

  a-r-r-o-w

  authored
  17b2753

  Copy full SHA for 17b2753

• add layernorm and groupnorm

  a-r-r-o-w

  committed
  edf8103

  Copy full SHA for edf8103

Commits on Jan 28, 2025

• Merge branch 'main' into groupwise-offloading

  a-r-r-o-w

  authored
  af62c93

  Copy full SHA for af62c93

Commits on Feb 4, 2025

• Merge branch 'main' into groupwise-offloading

  a-r-r-o-w

  committed
  f227e15

  Copy full SHA for f227e15

• address review comments

  a-r-r-o-w

  committed
  24f9273

  Copy full SHA for 24f9273

• improve tests; add docs

  a-r-r-o-w

  committed
  8f10d05

  Copy full SHA for 8f10d05

• improve docs

  a-r-r-o-w

  committed
  06b411f

  Copy full SHA for 06b411f

• Merge branch 'main' into groupwise-offloading

  a-r-r-o-w

  authored
  8bd7e3b

  Copy full SHA for 8bd7e3b

Commits on Feb 5, 2025

• Apply suggestions from code review

  Show description for 904e470
  

  a-r-r-o-w

  and

  stevhliu

  authored
  904e470

  Copy full SHA for 904e470

• apply suggestions from code review

  a-r-r-o-w

  committed
  3172ed5

  Copy full SHA for 3172ed5

• Merge branch 'main' into groupwise-offloading

  a-r-r-o-w

  authored
  72aa57f

  Copy full SHA for 72aa57f

• update tests

  a-r-r-o-w

  committed
  aee24bc

  Copy full SHA for aee24bc

Commits on Feb 6, 2025

• Merge branch 'main' into groupwise-offloading

  a-r-r-o-w

  committed
  db125ce

  Copy full SHA for db125ce

• apply suggestions from review

  a-r-r-o-w

  committed
  3f20e6b

  Copy full SHA for 3f20e6b

• enable_group_offloading -> enable_group_offload for naming consistency

  a-r-r-o-w

  committed
  840576a

  Copy full SHA for 840576a

• raise errors if multiple offloading strategies used; add relevant tests

  a-r-r-o-w

  committed
  8804d74

  Copy full SHA for 8804d74

• handle .to() when group offload applied

  a-r-r-o-w

  committed
  954bb7d

  Copy full SHA for 954bb7d

• Merge branch 'main' into groupwise-offloading

  a-r-r-o-w

  authored
  ba6c4a8

  Copy full SHA for ba6c4a8

• refactor some repeated code

  a-r-r-o-w

  committed
  da88c33

  Copy full SHA for da88c33

• remove unintentional change from merge conflict

  a-r-r-o-w

  committed
  a872e84

  Copy full SHA for a872e84

• handle .cuda()

  a-r-r-o-w

  committed
  6be43b8

  Copy full SHA for 6be43b8

Commits on Feb 11, 2025

• Merge branch 'main' into groupwise-offloading

  a-r-r-o-w

  authored
  274b84e

  Copy full SHA for 274b84e