New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

W4A16 in rk3588s #186

Open

ha-seungwon opened this issue Feb 24, 2025 · 2 comments

ha-seungwon commented Feb 24, 2025 •

edited

Loading

Hello,

Can I use int4 weight quantization method in 3588s board?

Collaborator

waydong commented Feb 24, 2025

hi, rk3588 does not suppport w4a16 currently。

wohaiaini commented Feb 25, 2025

perhaps ‘w8a8’ only

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment