Code

Reference speculative decoding#270

Code

Closed

hnyls2002 wants to merge 14 commits intomainsgl-project/sglang:mainfrom ref-specsgl-project/sglang:ref-specCopy head branch name to clipboard

+2,335-200

Commits

Commits on Mar 10, 2024

• implement reference speculative decoding

  hnyls2002

  committed
  8bcbea1

  Copy full SHA for 8bcbea1

• fix problems

  hnyls2002

  committed
  a8fd9d7

  Copy full SHA for a8fd9d7

• Merge branch 'main' into ref-spec

  hnyls2002

  committed
  4c05ce3

  Copy full SHA for 4c05ce3

• constrain triton version

  hnyls2002

  committed
  6549727

  Copy full SHA for 6549727

• update benchmark

  hnyls2002

  committed
  5f47adb

  Copy full SHA for 5f47adb

Commits on Mar 11, 2024

• Merge branch 'main' into ref-spec

  hnyls2002

  committed
  2ab3c28

  Copy full SHA for 2ab3c28

Commits on Mar 13, 2024

• fix triton version

  hnyls2002

  committed
  4fb35ce

  Copy full SHA for 4fb35ce

Commits on Mar 14, 2024

• rename

  hnyls2002

  committed
  7fb1395

  Copy full SHA for 7fb1395

Commits on Mar 16, 2024

• fix

  hnyls2002

  committed
  4293989

  Copy full SHA for 4293989

• naive kernel

  hnyls2002

  committed
  d1d8fb4

  Copy full SHA for d1d8fb4

• fused: verify + token

  hnyls2002

  committed
  38200df

  Copy full SHA for 38200df

Commits on Mar 18, 2024

• unify flatten tree mask style

  hnyls2002

  committed
  855edbe

  Copy full SHA for 855edbe

Commits on Mar 20, 2024

• make all mask bool type

  hnyls2002

  committed
  ea48f32

  Copy full SHA for ea48f32

• verify with decode

  hnyls2002

  committed
  00ebb01

  Copy full SHA for 00ebb01