Code

New weight loader without np copy#52

Code

Merged

zhuohan123 merged 6 commits intomainvllm-project/vllm:mainfrom new-weight-loadervllm-project/vllm:new-weight-loaderCopy head branch name to clipboardMay 3, 2023

+289-357

Commits

Commits on Apr 30, 2023

• New weight loader for OPT models

  zhuohan123

  committed
  8e5f1f7

  Copy full SHA for 8e5f1f7

Commits on May 1, 2023

• support llama

  zhuohan123

  committed
  f0cb731

  Copy full SHA for f0cb731

• fix loading for gpt_neox

  zhuohan123

  committed
  73a04ae

  Copy full SHA for 73a04ae

• Disable tqdm for downlading.

  zhuohan123

  committed
  f1f5d3a

  Copy full SHA for f1f5d3a

Commits on May 2, 2023

• Fix arguments & remove duplicated codes

  zhuohan123

  committed
  dde2e87

  Copy full SHA for dde2e87

Commits on May 3, 2023

• Fix review comments

  zhuohan123

  committed
  00353c5

  Copy full SHA for 00353c5