Code

Implementation of base ViT model#105

Code

Merged

darsnack merged 17 commits intoFluxML:masterFluxML/Metalhead.jl:masterfrom theabhirath:vittheabhirath/Metalhead.jl:vitCopy head branch name to clipboardFeb 11, 2022

+279-47

Commits

Commits on Feb 8, 2022

• Initial commit for base ViT model

  theabhirath

  committed
  bd962b2

  Copy full SHA for bd962b2

• Cleaned up ViT code

  theabhirath

  committed
  cfc0dbf

  Copy full SHA for cfc0dbf

• API tweaks and added docstrings for utility layers

  theabhirath

  committed
  5829e4d

  Copy full SHA for 5829e4d

• Updated MHAttention

  theabhirath

  committed
  0a3b43b

  Copy full SHA for 0a3b43b

• Updated deps

  theabhirath

  committed
  6e45252

  Copy full SHA for 6e45252

• Cleaned up APIs

  theabhirath

  committed
  f99f819

  Copy full SHA for f99f819

• Minor doc fixes

  theabhirath

  committed
  a8fa057

  Copy full SHA for a8fa057

Commits on Feb 10, 2022

• Formatting tweaks

  Show description for 79d69d0
  

  theabhirath

  and

  darsnack

  authored
  79d69d0

  Copy full SHA for 79d69d0

• Update src/layers.jl

  Show description for d2cf797
  

  theabhirath

  and

  darsnack

  authored
  d2cf797

  Copy full SHA for d2cf797

• Formatting

  theabhirath

  committed
  fc12748

  Copy full SHA for fc12748

• Merge branch 'vit' of https://github.com/theabhirath/Metalhead.jl into vit

  theabhirath

  committed
  2b63775

  Copy full SHA for 2b63775

• Chunk definitions update

  theabhirath

  committed
  65d90fb

  Copy full SHA for 65d90fb

• Minor tweaks

  Show description for a1d7a14
  

  theabhirath

  and

  mcabbott

  authored
  a1d7a14

  Copy full SHA for a1d7a14

• Changed dropout to be a keyword argument

  theabhirath

  committed
  078ce7d

  Copy full SHA for 078ce7d

• Merge branch 'vit' of https://github.com/theabhirath/Metalhead.jl into vit

  theabhirath

  committed
  f15a01e

  Copy full SHA for f15a01e

Commits on Feb 11, 2022

• Used MLUtils.chunk

  theabhirath

  committed
  52411cf

  Copy full SHA for 52411cf

• Use MLUtils.flatten

  theabhirath

  committed
  cf211e1

  Copy full SHA for cf211e1