academic-gypsy / RAYPool Public

Notifications You must be signed in to change notification settings
Fork 0
Star 0

An easy to implement high-throughput offline inference strategy for LLMs

0 stars 0 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 3 Commits
figure		figure
scripts		scripts
.gitignore		.gitignore
LICENSE		LICENSE
README.md		README.md
baseline.py		baseline.py
categories.py		categories.py
eval_vp.py		eval_vp.py
main.py		main.py
main_vp.py		main_vp.py
vp_utils.py		vp_utils.py

Repository files navigation

RAYPool

An easy to implement high-throughput offline inference strategy for LLMs

TODO

Feat README.md
Integrate RAYPool into lm-harness-evaluation

About

An easy to implement high-throughput offline inference strategy for LLMs

Report repository

Releases

No releases published

Packages

No packages published

Languages