Code

feat: improve qwen2-vl startup #2802

Code

Merged

drbh merged 5 commits intomainhuggingface/text-generation-inference:mainfrom improve-qwen2-vl-warmuphuggingface/text-generation-inference:improve-qwen2-vl-warmupCopy head branch name to clipboardJan 17, 2025

+173-95

Commits

Commits on Jan 16, 2025

• feat: tokenize each request individually and increase warmup image size

  drbh

  committed
  1bcfba3

  Copy full SHA for 1bcfba3

• feat: adjust rotary embed and avoid cuda graphs of size 2 and smaller

  drbh

  committed
  45e5c2c

  Copy full SHA for 45e5c2c

• fix: address image resize and rebase changes

  drbh

  committed
  822bd04

  Copy full SHA for 822bd04

• feat: update to run qwen2-vl tests

  drbh

  committed
  bd59f96

  Copy full SHA for bd59f96

• fix: tweak param types

  drbh

  committed
  37f92f2

  Copy full SHA for 37f92f2