Code

Elastic training support#602

Code

Merged

jeffra merged 34 commits intomasterdeepspeedai/DeepSpeed:masterfrom jeffra/elasticdeepspeedai/DeepSpeed:jeffra/elasticCopy head branch name to clipboardDec 23, 2020

Commits

Commits on Dec 10, 2020

• Starting to add config modifications. Currently in incomplete state

  

  samyam

  authored and

  jeffra

  committed
  a2689d9

  Copy full SHA for a2689d9

• Adding the core elasticity compatible gpu count generation logic

  

  samyam

  authored and

  jeffra

  committed
  cc54b0f

  Copy full SHA for cc54b0f

• Reverting some of the unfinished modifications to get the file working as standalone'

  

  samyam

  authored and

  jeffra

  committed
  3ee0bdd

  Copy full SHA for 3ee0bdd

• formatting and fix build error

  jeffra

  committed
  b16518f

  Copy full SHA for b16518f

• add np req and move elasticity

  jeffra

  committed
  1716858

  Copy full SHA for 1716858

• update github actions to trigger on all branches

  jeffra

  committed
  6e7896a

  Copy full SHA for 6e7896a

• fix syntax error

  jeffra

  committed
  072ace3

  Copy full SHA for 072ace3

• exclude docs

  jeffra

  committed
  64b6ef1

  Copy full SHA for 64b6ef1

• formatting

  jeffra

  committed
  56ec513

  Copy full SHA for 56ec513

• config restructure, versioning, etc

  jeffra

  committed
  a603970

  Copy full SHA for a603970

• config updates, sanity checks, etc.

  jeffra

  committed
  fbbd94d

  Copy full SHA for fbbd94d

• fix version issue

  jeffra

  committed
  78fd37a

  Copy full SHA for 78fd37a

• choose best micro batch size for given world size

  jeffra

  committed
  ca94dc8

  Copy full SHA for ca94dc8

• bug fixes

  jeffra

  committed
  bdf3415

  Copy full SHA for bdf3415

• add unit test

  jeffra

  committed
  5391541

  Copy full SHA for 5391541

• add several unit tests and clean-up code

  jeffra

  committed
  8691642

  Copy full SHA for 8691642

• fix install issue when installing on non-gpu machines

  jeffra

  committed
  805a067

  Copy full SHA for 805a067

Commits on Dec 14, 2020

• Merge branch 'master' into jeffra/elastic

  jeffra

  authored
  cd44deb

  Copy full SHA for cd44deb

Commits on Dec 15, 2020

• Merge branch 'master' into jeffra/elastic

  jeffra

  authored
  3275d9c

  Copy full SHA for 3275d9c

Commits on Dec 18, 2020

• Merge branch 'master' into jeffra/elastic

  jeffra

  authored
  d64f631

  Copy full SHA for d64f631

• Merge branch 'master' into jeffra/elastic

  jeffra

  authored
  cbf9063

  Copy full SHA for cbf9063

• add ds_elastic cli

  jeffra

  committed
  07caa68

  Copy full SHA for 07caa68

• clean-up

  jeffra

  committed
  b4f6d71

  Copy full SHA for b4f6d71

• formatting

  jeffra

  committed
  8b784ce

  Copy full SHA for 8b784ce

• docstring

  jeffra

  committed
  dd30992

  Copy full SHA for dd30992

• fix mbsize division issue

  jeffra

  committed
  c925a53

  Copy full SHA for c925a53

• formatting

  jeffra

  committed
  16f9aa2

  Copy full SHA for 16f9aa2

• checkpoint load latest only if it exists

  jeffra

  committed
  80a642f

  Copy full SHA for 80a642f

• add get_batch_info to engine, assert non-elastic bsz config, fix test

  jeffra

  committed
  01ee3a4

  Copy full SHA for 01ee3a4

Commits on Dec 19, 2020

• fix tests

  jeffra

  committed
  c6a23c1

  Copy full SHA for c6a23c1

• validate elastic config wrt scheduler config, add repr

  jeffra

  committed
  2e6b35f

  Copy full SHA for 2e6b35f

• add unit test and fixes

  jeffra

  committed
  1af4330

  Copy full SHA for 1af4330

Commits on Dec 22, 2020

• require max-batch and micro-batches for elastic training

  jeffra

  committed
  d030583

  Copy full SHA for d030583

• fix test error

  jeffra

  committed
  6b6235b

  Copy full SHA for 6b6235b