-
-
Notifications
You must be signed in to change notification settings - Fork 5.9k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Quality] Add code formatter and linter #326
Conversation
@WoosukKwon This PR is ready for review. Let's decide when is a good time to merge the formatter. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@zhuohan123 Thanks for the hard work! Left some comments.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM! Thanks again for the hard work!
how to add history argument? |
SUMMARY: * updated hf lm-eval gsm baseline script to use accelerate, enabling us to generate baselines on big models' * added vllm lm-eval gsm baseline script for scenarios that hf does not support (e.g. fp8) * added lm-eval GSM model configs for broad set of models (small + large) * refactored smoke / full configs to reference the model configs + trigger one test at a time * refactored lm-eval accuracy test to avoid using ray to launch server, which caused issues cleaning up in server case * moved configs into `.github` folder so they are closer to the scripts FOLLOW UP PRS: * enable distributed * enable H100 for large models * eliminate the `neuralmagic` directory
Partially fix #57. Adding formatter and linter.
TODO: Add formatter into CI.