Code

[Model] Add T5 model (2/2) #11901

Code

Open

NickLucche wants to merge 13 commits intovllm-project:mainvllm-project/vllm:mainfrom NickLucche:t5-modelNickLucche/vllm:t5-modelCopy head branch name to clipboard

+1,242-263

Commits

Commits on Feb 17, 2025

• add working kernel with padded_max_seq_len as arg

  Show description for 98eaf1f
  NickLucche

  committed
  98eaf1f

  Copy full SHA for 98eaf1f

• add attn_bias case to pagedattn tests

  Show description for 752be56
  NickLucche

  committed
  752be56

  Copy full SHA for 752be56

• format

  Show description for 8703add
  NickLucche

  committed
  8703add

  Copy full SHA for 8703add

• enforce last dim of attn bias to be block aligned

  Show description for 0ef1470
  NickLucche

  committed
  0ef1470

  Copy full SHA for 0ef1470

• fix blocksparse tests

  Show description for 6228f76
  NickLucche

  committed
  6228f76

  Copy full SHA for 6228f76

• fix rebase

  Show description for 29c0fa9
  NickLucche

  committed
  29c0fa9

  Copy full SHA for 29c0fa9

• first working version :)

  NickLucche

  committed
  e61d993

  Copy full SHA for e61d993

• address missing bos token case

  Show description for 2689b6e
  NickLucche

  committed
  2689b6e

  Copy full SHA for 2689b6e

• t5 tests

  Show description for 066faf7
  NickLucche

  committed
  066faf7

  Copy full SHA for 066faf7

• sync with custom attn bias pr

  Show description for 22bd43c
  NickLucche

  committed
  22bd43c

  Copy full SHA for 22bd43c

• update to use new attention_type interface

  Show description for c3efe6f
  NickLucche

  committed
  c3efe6f

  Copy full SHA for c3efe6f

Commits on Feb 18, 2025

• cuda graph support

  Show description for cd4e1a9
  NickLucche

  committed
  cd4e1a9

  Copy full SHA for cd4e1a9

Commits on Feb 19, 2025

• format

  Show description for d1f2e3b
  NickLucche

  committed
  d1f2e3b

  Copy full SHA for d1f2e3b