Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

GGML_ASSERT:0 <= info->type && info->type < GGML_TYPE_COUNT #191

Closed
weiyuemin opened this issue Feb 25, 2025 · 2 comments
Closed

GGML_ASSERT:0 <= info->type && info->type < GGML_TYPE_COUNT #191

weiyuemin opened this issue Feb 25, 2025 · 2 comments

Comments

@weiyuemin
Copy link

跑llm_demo的时候遇到了这个错误，请问是什么问题

./llm_demo DeepSeek-R1-Distill-Qwen-1.5B_W8A8_RK3588.rkllm 200 200
rkllm init start
rkllm-runtime version: 1.0.1, rknpu driver version: 0.9.6, platform: RK3588
GGML_ASSERT:0 <= info->type && info->type < GGML_TYPE_COUNT
Aborted (core dumped)

也试了 Qwen1.5-0.5B_W8A8_RK3588.rkllm，效果一样
@waydong
Copy link
Collaborator

waydong commented Feb 25, 2025

hi, rkllm-runtime版本太低了，请使用1.1.4版本

@weiyuemin
Copy link
Author

感谢，好了~

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@weiyuemin @waydong