Code

[App] Introduce auto scaler#15769

Code

Merged

lantiga merged 127 commits intomasterLightning-AI/pytorch-lightning:masterfrom feat/load-balancer-componentLightning-AI/pytorch-lightning:feat/load-balancer-componentCopy head branch name to clipboardDec 7, 2022

+756

Commits

Commits on Nov 22, 2022

• Exlucde __pycache__ in setuptools

  akihironitta

  committed
  e0cb13e

  Copy full SHA for e0cb13e

Commits on Nov 23, 2022

• Merge branch 'master' into bugfix/dont-collect-pycache

  akihironitta

  authored
  6e5a030

  Copy full SHA for 6e5a030

Commits on Nov 24, 2022

• Add load balancer example

  akihironitta

  committed
  f162e96

  Copy full SHA for f162e96

• Merge branch 'master' into bugfix/dont-collect-pycache

  akihironitta

  authored
  324d41d

  Copy full SHA for 324d41d

• wip

  akihironitta

  committed
  0725439

  Copy full SHA for 0725439

• Merge branch 'bugfix/dont-collect-pycache' into feat/load-balancer-component

  akihironitta

  committed
  0d67fd2

  Copy full SHA for 0d67fd2

• Update example

  akihironitta

  committed
  9cc237f

  Copy full SHA for 9cc237f

• rename

  akihironitta

  committed
  9594371

  Copy full SHA for 9594371

• remove prints

  akihironitta

  committed
  fc64ceb

  Copy full SHA for fc64ceb

• _LoadBalancer -> LoadBalancer

  akihironitta

  committed
  c4b5ac0

  Copy full SHA for c4b5ac0

• AutoScaler(work)

  akihironitta

  committed
  4c61501

  Copy full SHA for 4c61501

• change var name

  akihironitta

  committed
  dc72f1a

  Copy full SHA for dc72f1a

• remove locust

  akihironitta

  committed
  57943ac

  Copy full SHA for 57943ac

• Merge branch 'master' into feat/load-balancer-component

  akihironitta

  committed
  8aa68d9

  Copy full SHA for 8aa68d9

• Update docs

  akihironitta

  committed
  b6a9918

  Copy full SHA for b6a9918

• Merge branch 'docs/add-missing-components' into feat/load-balancer-component

  akihironitta

  committed
  744ddbe

  Copy full SHA for 744ddbe

• include autoscaler in api ref

  akihironitta

  committed
  16f7333

  Copy full SHA for 16f7333

• docs typo

  akihironitta

  committed
  cd9929c

  Copy full SHA for cd9929c

• docs typo

  akihironitta

  committed
  f33874e

  Copy full SHA for f33874e

• docs typo

  akihironitta

  committed
  12d12b4

  Copy full SHA for 12d12b4

• docs typo

  akihironitta

  committed
  656b0b6

  Copy full SHA for 656b0b6

• remove unused loadtest

  akihironitta

  committed
  a5859f7

  Copy full SHA for a5859f7

• remove unused device_type

  akihironitta

  committed
  1bdf1bc

  Copy full SHA for 1bdf1bc

• clean up

  akihironitta

  committed
  1cb366f

  Copy full SHA for 1cb366f

• clean up

  akihironitta

  committed
  fb4d2e5

  Copy full SHA for fb4d2e5

• clean up

  akihironitta

  committed
  c0ba351

  Copy full SHA for c0ba351

• Add docstring

  akihironitta

  committed
  666918b

  Copy full SHA for 666918b

• type

  akihironitta

  committed
  6f0f43f

  Copy full SHA for 6f0f43f

• Merge branch 'master' into feat/load-balancer-component

  akihironitta

  committed
  24cb9c0

  Copy full SHA for 24cb9c0

Commits on Nov 25, 2022

• env vars to args

  akihironitta

  committed
  9cda544

  Copy full SHA for 9cda544

• expose an API for users to override to customise autoscaling logic

  akihironitta

  committed
  609eb10

  Copy full SHA for 609eb10

• update example

  akihironitta

  committed
  4e779a1

  Copy full SHA for 4e779a1

• comment

  akihironitta

  committed
  92737e4

  Copy full SHA for 92737e4

• udpate var name

  akihironitta

  committed
  04c3a72

  Copy full SHA for 04c3a72

• fix scale mechanism and clean up

  akihironitta

  committed
  52d240e

  Copy full SHA for 52d240e

• Update exampl

  akihironitta

  committed
  6d18f24

  Copy full SHA for 6d18f24

• ignore mypy

  akihironitta

  committed
  5c5197e

  Copy full SHA for 5c5197e

• Add test file

  akihironitta

  committed
  98d56ad

  Copy full SHA for 98d56ad

• .

  akihironitta

  committed
  b34076e

  Copy full SHA for b34076e

• Merge branch 'master' into docs/add-missing-components

  akihironitta

  authored
  dfc5dff

  Copy full SHA for dfc5dff

• Merge branch 'docs/add-missing-components' into feat/load-balancer-component

  akihironitta

  committed
  c139ede

  Copy full SHA for c139ede

Commits on Nov 28, 2022

• update impl and update tests

  akihironitta

  committed
  26ca77d

  Copy full SHA for 26ca77d

• Merge branch 'master' into feat/load-balancer-component

  akihironitta

  committed
  5082d44

  Copy full SHA for 5082d44

• Update changlog

  akihironitta

  committed
  c230254

  Copy full SHA for c230254

• .

  akihironitta

  committed
  80e6b7d

  Copy full SHA for 80e6b7d

• revert docs

  akihironitta

  committed
  2aeec1c

  Copy full SHA for 2aeec1c

• update test

  akihironitta

  committed
  8091ca9

  Copy full SHA for 8091ca9

• update state to keep calling 'flow.run()'

  Show description for a2bfaed
  

  akihironitta

  and

  aniketmaurya

  committed
  a2bfaed

  Copy full SHA for a2bfaed

• Add aiohttp to base requirements

  akihironitta

  committed
  eb784fe

  Copy full SHA for eb784fe

• Update docs

  Show description for 9208959
  

  akihironitta

  and

  lantiga

  authored
  9208959

  Copy full SHA for 9208959

• Use deserializer utility

  akihironitta

  committed
  15dc3ae

  Copy full SHA for 15dc3ae

• fake trigger

  akihironitta

  committed
  7ffd45a

  Copy full SHA for 7ffd45a

• wip: protect /system/* with basic auth

  akihironitta

  committed
  10627e9

  Copy full SHA for 10627e9

Commits on Nov 29, 2022

• read password at runtime

  akihironitta

  committed
  f79d16b

  Copy full SHA for f79d16b

• Change env var name

  akihironitta

  committed
  ae7f300

  Copy full SHA for ae7f300

• import torch as optional

  akihironitta

  committed
  8ea25d1

  Copy full SHA for 8ea25d1

• Merge branch 'master' into feat/load-balancer-component

  akihironitta

  authored
  a0fb484

  Copy full SHA for a0fb484

• Don't overcreate works

  akihironitta

  committed
  9e66136

  Copy full SHA for 9e66136

• simplify imports

  akihironitta

  committed
  94600d7

  Copy full SHA for 94600d7

• Update example

  akihironitta

  committed
  15dca21

  Copy full SHA for 15dca21

• aiohttp

  Borda

  authored
  8d65628

  Copy full SHA for 8d65628

• Add work_args work_kwargs

  akihironitta

  committed
  fe5c0f4

  Copy full SHA for fe5c0f4

• More docs

  akihironitta

  committed
  77faca5

  Copy full SHA for 77faca5

• Merge remote-tracking branch 'origin/feat/load-balancer-component' into feat/load-balancer-component

  akihironitta

  committed
  cf32733

  Copy full SHA for cf32733

• remove FIXME

  akihironitta

  committed
  39de0ba

  Copy full SHA for 39de0ba

• Apply Jirka's suggestions

  Show description for a49766d
  

  akihironitta

  and

  Borda

  authored
  a49766d

  Copy full SHA for a49766d

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for 6861444
  pre-commit-ci[bot]

  committed
  6861444

  Copy full SHA for 6861444

• clean example device

  akihironitta

  committed
  2b95111

  Copy full SHA for 2b95111

• add comment on init threshold value

  akihironitta

  committed
  5af2569

  Copy full SHA for 5af2569

• bad merge

  akihironitta

  committed
  69ec4c3

  Copy full SHA for 69ec4c3

• Merge remote-tracking branch 'origin/feat/load-balancer-component' into feat/load-balancer-component

  akihironitta

  committed
  64d99e4

  Copy full SHA for 64d99e4

• nit: logging format

  akihironitta

  committed
  61433b3

  Copy full SHA for 61433b3

• {in,out}put_schema -> {in,out}put_type

  akihironitta

  committed
  f9debb6

  Copy full SHA for f9debb6

• lowercase

  akihironitta

  committed
  e534e09

  Copy full SHA for e534e09

• docs on seconds

  akihironitta

  committed
  87e2882

  Copy full SHA for 87e2882

• process_time -> processing_time

  akihironitta

  committed
  7f2731d

  Copy full SHA for 7f2731d

• Dont modify work state from flow

  akihironitta

  committed
  a933247

  Copy full SHA for a933247

• Update tests

  akihironitta

  committed
  5d7d1c3

  Copy full SHA for 5d7d1c3

• worker_url -> endpoint

  akihironitta

  committed
  73cf389

  Copy full SHA for 73cf389

• fix exampl

  akihironitta

  committed
  8840b85

  Copy full SHA for 8840b85

Commits on Nov 30, 2022

• Fix default scale logic

  akihironitta

  committed
  b7301e6

  Copy full SHA for b7301e6

• Fix default scale logic

  akihironitta

  committed
  c8d0c86

  Copy full SHA for c8d0c86

• Fix num_pending_works

  akihironitta

  committed
  ad5b8e5

  Copy full SHA for ad5b8e5

Commits on Dec 1, 2022

• Update num_pending_works

  akihironitta

  committed
  9a43d31

  Copy full SHA for 9a43d31

• Fix bug creating too many works

  akihironitta

  committed
  ce4d257

  Copy full SHA for ce4d257

• Remove up/downscale_threshold args

  akihironitta

  committed
  9bebb86

  Copy full SHA for 9bebb86

• Update example

  akihironitta

  committed
  8b14154

  Copy full SHA for 8b14154

• Add typing

  akihironitta

  committed
  611077e

  Copy full SHA for 611077e

• Merge branch 'master' into feat/load-balancer-component

  akihironitta

  committed
  7a627ac

  Copy full SHA for 7a627ac

• Fix example in docstring

  akihironitta

  committed
  4e93898

  Copy full SHA for 4e93898

• Fix default scale logic

  akihironitta

  committed
  1e42f55

  Copy full SHA for 1e42f55

• Update src/lightning_app/components/auto_scaler.py

  Show description for 0b6153a
  

  akihironitta

  and

  nohalon

  authored
  0b6153a

  Copy full SHA for 0b6153a

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for 6d677c1
  pre-commit-ci[bot]

  committed
  6d677c1

  Copy full SHA for 6d677c1

• rename method

  akihironitta

  committed
  67bbe49

  Copy full SHA for 67bbe49

• rename locvar

  akihironitta

  committed
  e524702

  Copy full SHA for e524702

• Add todo

  akihironitta

  committed
  2f24422

  Copy full SHA for 2f24422

• docs ci

  akihironitta

  committed
  a20797d

  Copy full SHA for a20797d

• docs ci

  akihironitta

  committed
  a8a8aaa

  Copy full SHA for a8a8aaa

• asdfafsdasdf pls docs

  akihironitta

  committed
  09dfda5

  Copy full SHA for 09dfda5

Commits on Dec 2, 2022

• Apply suggestions from code review

  Show description for 11842b0
  

  akihironitta

  and

  ethanwharris

  authored
  11842b0

  Copy full SHA for 11842b0

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for 29059a0
  pre-commit-ci[bot]

  committed
  29059a0

  Copy full SHA for 29059a0

Commits on Dec 5, 2022

• Merge branch 'master' into feat/load-balancer-component

  

  Akihiro Nitta

  committed
  a35b4c8

  Copy full SHA for a35b4c8

• .

  akihironitta

  committed
  4285506

  Copy full SHA for 4285506

• doc

  akihironitta

  committed
  72a6f13

  Copy full SHA for 72a6f13

• Update src/lightning_app/components/auto_scaler.py

  Show description for 56ea78b
  

  akihironitta

  and

  nohalon

  authored
  56ea78b

  Copy full SHA for 56ea78b

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for 24983a0
  pre-commit-ci[bot]

  committed
  24983a0

  Copy full SHA for 24983a0

• Revert "[pre-commit.ci] auto fixes from pre-commit.com hooks"

  Show description for 27431f4
  akihironitta

  committed
  27431f4

  Copy full SHA for 27431f4

• Revert "Update src/lightning_app/components/auto_scaler.py"

  Show description for b7dd2c1
  akihironitta

  committed
  b7dd2c1

  Copy full SHA for b7dd2c1

Commits on Dec 6, 2022

• Merge branch 'master' into feat/load-balancer-component

  akihironitta

  authored
  ebcfc51

  Copy full SHA for ebcfc51

• Remove redefinition

  akihironitta

  committed
  a634446

  Copy full SHA for a634446

• Remove load balancer run blocker

  akihironitta

  committed
  64a1960

  Copy full SHA for 64a1960

• raise RuntimeError

  akihironitta

  committed
  fba7a3c

  Copy full SHA for fba7a3c

• remove has_sent

  akihironitta

  committed
  4ccc38c

  Copy full SHA for 4ccc38c

• lower the default timeout_batching from 10 to 1

  akihironitta

  committed
  aa1785c

  Copy full SHA for aa1785c

• remove debug

  akihironitta

  committed
  7c09716

  Copy full SHA for 7c09716

• update the default timeout_batching

  akihironitta

  committed
  ff2009a

  Copy full SHA for ff2009a

• .

  akihironitta

  committed
  839734d

  Copy full SHA for 839734d

• tighten condition

  akihironitta

  committed
  6a553b9

  Copy full SHA for 6a553b9

• fix endpoint

  akihironitta

  committed
  506e192

  Copy full SHA for 506e192

• typo in runtimeerror cond

  akihironitta

  committed
  205c0af

  Copy full SHA for 205c0af

• async lock update severs

  akihironitta

  committed
  6d76b0d

  Copy full SHA for 6d76b0d

• add a test

  akihironitta

  committed
  2233098

  Copy full SHA for 2233098

• {in,out}put_type typing

  akihironitta

  committed
  4526496

  Copy full SHA for 4526496

• Merge branch 'master' into feat/load-balancer-component

  tchaton

  authored
  00fed69

  Copy full SHA for 00fed69

Commits on Dec 7, 2022

• Update examples/app_server_with_auto_scaler/app.py

  Show description for 468b626
  

  akihironitta

  and

  Borda

  authored
  468b626

  Copy full SHA for 468b626

• Update .actions/setup_tools.py

  akihironitta

  authored
  5b2b69f

  Copy full SHA for 5b2b69f

• Merge branch 'master' into feat/load-balancer-component

  akihironitta

  authored
  2c41e38

  Copy full SHA for 2c41e38