New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

musa: support bf16 #608

Open

yeahdongcn wants to merge 1 commit into kvcache-ai:main from makllama:fix_musa_ext

+4 −1

Contributor

yeahdongcn commented Feb 23, 2025

In recent changes, nv_bfloat16 is now used in building the KTransformers extension. This PR adds support for nv_bfloat16 on the MUSA side.

Testing Done

make dev_install


          musa: support bf16

18b1d18

Signed-off-by: Xiaodong Ye <[email protected]>

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet