Code

Optimize data movement#20

Code

Merged

WoosukKwon merged 19 commits intomainvllm-project/vllm:mainfrom data-movevllm-project/vllm:data-moveCopy head branch name to clipboardApr 2, 2023

+275-135

Commits

Commits on Mar 30, 2023

• Merge QKV for OPT

  zhuohan123

  committed
  28df307

  Copy full SHA for 28df307

• merge qkv for llama

  zhuohan123

  committed
  2e417f5

  Copy full SHA for 2e417f5

Commits on Mar 31, 2023

• fix the code according to woosuk's comment

  zhuohan123

  committed
  06f23ff

  Copy full SHA for 06f23ff

• Merge branch 'main' into qkv_combined

  zhuohan123

  committed
  da0fdd2

  Copy full SHA for da0fdd2

Commits on Apr 1, 2023

• Merge branch 'main' into qkv_combined

  WoosukKwon

  committed
  b1ba1e4

  Copy full SHA for b1ba1e4

• Add SiluAndMul

  WoosukKwon

  committed
  9c5eca0

  Copy full SHA for 9c5eca0

• Remove

  WoosukKwon

  committed
  a5719c1

  Copy full SHA for a5719c1

• Merge branch 'activation' into qkv_combined

  WoosukKwon

  committed
  07fb828

  Copy full SHA for 07fb828

• Add SiluAndMul for fused SwiGLU

  WoosukKwon

  committed
  47622ec

  Copy full SHA for 47622ec

• Optimize data movement in attention

  WoosukKwon

  committed
  c3816b8

  Copy full SHA for c3816b8

Commits on Apr 2, 2023

• Add activation_ops to setup.py

  WoosukKwon

  committed
  b8d0024

  Copy full SHA for b8d0024

• Make rotary embedding in-place

  WoosukKwon

  committed
  3f8dd53

  Copy full SHA for 3f8dd53

• Bug fix

  WoosukKwon

  committed
  07e2bca

  Copy full SHA for 07e2bca

• Roll back attention arguments

  WoosukKwon

  committed
  8a37545

  Copy full SHA for 8a37545

• Merge branch 'main' into data-move

  WoosukKwon

  committed
  0417554

  Copy full SHA for 0417554

• Fix test for reshape_and_cache

  WoosukKwon

  committed
  e2a47cc

  Copy full SHA for e2a47cc

• Fix test for rotary_embedding_neox

  WoosukKwon

  committed
  df402bb

  Copy full SHA for df402bb

• Fix test for attention kernels

  WoosukKwon

  committed
  7152271

  Copy full SHA for 7152271

• Merge branch 'main' into data-move

  WoosukKwon

  committed
  0132133

  Copy full SHA for 0132133