Code

Feature/non contiguous kv cache#513

Code

Merged

yzh119 merged 7 commits intoflashinfer-ai:mainflashinfer-ai/flashinfer:mainfrom LinHeLurking:feature/non-contiguous-kv-cacheLinHeLurking/flashinfer:feature/non-contiguous-kv-cacheCopy head branch name to clipboardOct 9, 2024

+484-439

Commits

Commits on Oct 8, 2024

• feat: non-contiguous paged kv cache

  Show description for 028b6fa
  

  LinHeLurking

  authored and

  yzh119

  committed
  028b6fa

  Copy full SHA for 028b6fa

• test: add prefill/decode test for non-contiguous kv cache

  Show description for 303c087
  

  LinHeLurking

  authored and

  yzh119

  committed
  303c087

  Copy full SHA for 303c087

Commits on Oct 9, 2024

• upd

  yzh119

  committed
  933aa6a

  Copy full SHA for 933aa6a

• upd

  yzh119

  committed
  cdd54c6

  Copy full SHA for cdd54c6

• upd

  yzh119

  committed
  f8d7129

  Copy full SHA for f8d7129

• upd

  yzh119

  committed
  89a2100

  Copy full SHA for 89a2100

• revert some changes on tests

  yzh119

  committed
  02fb9ea

  Copy full SHA for 02fb9ea