Code

Add Video Swin Transformer#2369

Code

Merged

divyashreepathihalli merged 94 commits intokeras-team:masterkeras-team/keras-cv:masterfrom innat:video_swininnat/keras-cv:video_swinCopy head branch name to clipboardApr 5, 2024

+2,171

Commits

Commits on Mar 1, 2024

• init video swin

  innat

  committed
  f961e75

  Copy full SHA for f961e75

• add: 3d window size computation

  innat

  committed
  578205a

  Copy full SHA for 578205a

• add: mlp layer

  innat

  committed
  9817025

  Copy full SHA for 9817025

• add: patch embedding layer

  innat

  committed
  3343db1

  Copy full SHA for 3343db1

• add: patch merging layer

  innat

  committed
  7ab5cab

  Copy full SHA for 7ab5cab

• add: window attention layer

  innat

  committed
  f70a61b

  Copy full SHA for f70a61b

• add: basic layer for video swin

  innat

  committed
  5472fc6

  Copy full SHA for 5472fc6

• update: basic layer for video swin

  innat

  committed
  76d444b

  Copy full SHA for 76d444b

• add: swin blocks for video swin

  innat

  committed
  715b8a3

  Copy full SHA for 715b8a3

• create and add: video swin backbone

  innat

  committed
  3ca0042

  Copy full SHA for 3ca0042

• rename: video swin layers to model specific

  innat

  committed
  3d845c5

  Copy full SHA for 3d845c5

• update module import

  innat

  committed
  1af8bd4

  Copy full SHA for 1af8bd4

• update module import

  innat

  committed
  ed2864d

  Copy full SHA for ed2864d

• set class method to private usage

  innat

  committed
  bf70fa9

  Copy full SHA for bf70fa9

• set init params for backbone

  innat

  committed
  eca5023

  Copy full SHA for eca5023

• rm redundant imports

  innat

  committed
  420e229

  Copy full SHA for 420e229

• add video swin layer test cases

  innat

  committed
  f73e25b

  Copy full SHA for f73e25b

• add: videoswin backbone aliases

  innat

  committed
  1ccf7ee

  Copy full SHA for 1ccf7ee

• add: video swin backbone presets

  innat

  committed
  c5d5fa2

  Copy full SHA for c5d5fa2

• add: video swin backbone presets test

  innat

  committed
  27b6596

  Copy full SHA for 27b6596

• update: video swin backbone presets test

  innat

  committed
  814db52

  Copy full SHA for 814db52

• add: video classifier task

  innat

  committed
  cc6ac21

  Copy full SHA for cc6ac21

• add: video swin classifier presets

  innat

  committed
  d2d883d

  Copy full SHA for d2d883d

• run formatters

  innat

  committed
  125b2dc

  Copy full SHA for 125b2dc

Commits on Mar 2, 2024

• rename module name/id"

  innat

  committed
  9827302

  Copy full SHA for 9827302

• add hard-coded normalization for include rescaling=true

  innat

  committed
  89a715a

  Copy full SHA for 89a715a

• add docstring for videoswin backbone

  innat

  committed
  36db030

  Copy full SHA for 36db030

• update metadata: backbone presets no weights

  innat

  committed
  7aa27a4

  Copy full SHA for 7aa27a4

• update: backbone presets no weights test

  innat

  committed
  62a8703

  Copy full SHA for 62a8703

• update video swin aliases for no weights

  innat

  committed
  aad5661

  Copy full SHA for aad5661

• add: video swin backbone presets with weights

  innat

  committed
  048d85a

  Copy full SHA for 048d85a

• update: video swin aliases with weights presets

  innat

  committed
  1423e83

  Copy full SHA for 1423e83

• update video swin layer test cases

  innat

  committed
  2eaf8b0

  Copy full SHA for 2eaf8b0

• added patch merging test

  innat

  committed
  f713304

  Copy full SHA for f713304

• imported video swins presets to backbone presets list"

  innat

  committed
  44dae81

  Copy full SHA for 44dae81

• fix: typos"

  innat

  committed
  daca84f

  Copy full SHA for daca84f

• run formatters"

  innat

  committed
  b1a5427

  Copy full SHA for b1a5427

• fix: linting issue

  innat

  committed
  c66673c

  Copy full SHA for c66673c

• fix: linting issue

  innat

  committed
  84d4e03

  Copy full SHA for 84d4e03

Commits on Mar 3, 2024

• fix: video swin layer test cases"

  innat

  committed
  d126b7c

  Copy full SHA for d126b7c

• add: video swin backbone test

  innat

  committed
  61303be

  Copy full SHA for 61303be

• rm redundant code

  innat

  committed
  af5878c

  Copy full SHA for af5878c

Commits on Mar 4, 2024

• disable preset test temporary

  innat

  committed
  ffe457c

  Copy full SHA for ffe457c

• set include rescale to true

  innat

  committed
  f8d3e26

  Copy full SHA for f8d3e26

• add video swin components to __init__

  innat

  committed
  1d0ad36

  Copy full SHA for 1d0ad36

Commits on Mar 5, 2024

• update docstrings: video siwn layers scripts

  innat

  committed
  838a506

  Copy full SHA for 838a506

• update copywrite status: video siwn layers test scripts

  innat

  committed
  b4f1534

  Copy full SHA for b4f1534

• update copywrite status: video siwn backbone scripts

  innat

  committed
  75c5b66

  Copy full SHA for 75c5b66

• bug fixes: video swin backbone layers

  innat

  committed
  0b9808b

  Copy full SHA for 0b9808b

• update get config of video swin backbone

  innat

  committed
  0a4e2cb

  Copy full SHA for 0a4e2cb

• enable: video swin backbone test cases

  innat

  committed
  fb732d0

  Copy full SHA for fb732d0

• update: video swin backbone test cases

  innat

  committed
  4443335

  Copy full SHA for 4443335

• update: video swin backbone preset test cases

  innat

  committed
  f3411cb

  Copy full SHA for f3411cb

• run formatters

  innat

  committed
  00c67ba

  Copy full SHA for 00c67ba

• fix typos: video swin backbone test cases

  innat

  committed
  9d3ab2e

  Copy full SHA for 9d3ab2e

• add: non implemented property for test reason

  innat

  committed
  5bdc8b4

  Copy full SHA for 5bdc8b4

• fix: typos

  innat

  committed
  cb5da28

  Copy full SHA for cb5da28

Commits on Mar 6, 2024

• add: video classifier test

  innat

  committed
  82a8497

  Copy full SHA for 82a8497

• update: video classifier test

  innat

  committed
  e2f5056

  Copy full SHA for e2f5056

• update: video classifier test input shape

  innat

  committed
  146f32f

  Copy full SHA for 146f32f

• bug fix: mlp layer build method

  innat

  committed
  d25746b

  Copy full SHA for d25746b

• updated: swin back layer build method

  innat

  committed
  9779ad4

  Copy full SHA for 9779ad4

• bug fix: use tf.TensorShape in compute_output_shape method

  innat

  committed
  7fa3f83

  Copy full SHA for 7fa3f83

• update: video_classifier_test model.predict to model.call

  innat

  committed
  c8aea50

  Copy full SHA for c8aea50

• update test cases and format the code

  innat

  committed
  8287395

  Copy full SHA for 8287395

Commits on Mar 9, 2024

• update docstrings and preset config

  innat

  committed
  e9a3997

  Copy full SHA for e9a3997

Commits on Mar 10, 2024

• fix jax DynamicJaxprTrace issue for

  innat

  committed
  aab1a6c

  Copy full SHA for aab1a6c

Commits on Mar 11, 2024

• update config of backbone aliases

  innat

  committed
  ac78108

  Copy full SHA for ac78108

Commits on Mar 18, 2024

• add can run in mixed precision test

  innat

  committed
  1dbded9

  Copy full SHA for 1dbded9

• add can run on gray video

  innat

  committed
  42003a2

  Copy full SHA for 42003a2

• minor fix

  innat

  committed
  e731389

  Copy full SHA for e731389

Commits on Mar 20, 2024

• specify axis in keras.ops.take to match with tf.gather

  innat

  committed
  77197c2

  Copy full SHA for 77197c2

Commits on Mar 24, 2024

• specify include rescaling to backbone class

  innat

  committed
  aa20067

  Copy full SHA for aa20067

• remove shift size form get config of video basic layer

  innat

  committed
  11f33d7

  Copy full SHA for 11f33d7

• add support arbitrary input shape

  innat

  committed
  a2961b9

  Copy full SHA for a2961b9

• minor updates to swin layers

  innat

  committed
  49b074a

  Copy full SHA for 49b074a

• test method update for swin layers

  innat

  committed
  204e4b1

  Copy full SHA for 204e4b1

• update test method to swin backbone

  innat

  committed
  251495b

  Copy full SHA for 251495b

• remove unsed code

  innat

  committed
  599d481

  Copy full SHA for 599d481

• bug fix in call method of patch embed layer

  innat

  committed
  a849b38

  Copy full SHA for a849b38

• fix typo in patch merging layer

  innat

  committed
  f611b0e

  Copy full SHA for f611b0e

• minor fix

  innat

  committed
  b7d26e4

  Copy full SHA for b7d26e4

Commits on Mar 25, 2024

• fix keras.ops.cond issue with jax

  innat

  committed
  e3e02dc

  Copy full SHA for e3e02dc

• no test for jit compile in torch

  innat

  committed
  a626b1f

  Copy full SHA for a626b1f

• reduce tensor size for forward test

  innat

  committed
  c484445

  Copy full SHA for c484445

Commits on Mar 28, 2024

• minor fix

  innat

  committed
  45945c9

  Copy full SHA for 45945c9

Commits on Mar 31, 2024

• remove kcv export decorator

  innat

  committed
  f866d12

  Copy full SHA for f866d12

• update keras.Layer import

  innat

  committed
  bfb62a4

  Copy full SHA for bfb62a4

• remove unused layer import

  innat

  committed
  57f0012

  Copy full SHA for 57f0012

• replace keras.layers instead of layers

  innat

  committed
  7602052

  Copy full SHA for 7602052

• update keras.Layer to keras.layers.Layer for keras2

  innat

  committed
  837286d

  Copy full SHA for 837286d

• add window_size param to aliases

  innat

  committed
  6d44eca

  Copy full SHA for 6d44eca

Commits on Apr 2, 2024

• move vide swin layer to model specific directory

  innat

  committed
  f5dce04

  Copy full SHA for f5dce04

• minor fix

  innat

  committed
  0ba9fdf

  Copy full SHA for 0ba9fdf