Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

使用DeepSeek-R1-Distill-Qwen-1.5B_W8A8_RK3588.rkllm进行推理时,选择第一个例子之后,一直报matmul run failed #187

Open
pxrgod opened this issue Feb 24, 2025 · 3 comments

Comments

@pxrgod
Copy link

pxrgod commented Feb 24, 2025

Seek-R1-Distill-Qwen-1.5B_W8A8_RK3588.rkllm 2048 4096 <
rkllm init start
W rkllm: Warning: Your rknpu driver version is too low, please upgrade to 0.9.7.

I rkllm: rkllm-runtime version: 1.1.4, rknpu driver version: 0.8.2, platform: RK3588

rkllm init success

**可输入以下问题对应序号获取回答/或自定义输入

[0] 现有一笼子,里面有鸡和兔子若干只,数一数,共有头14个,腿38条,求鸡和兔子各有多少只?
[1] 有28位小朋友排成一行,从左边开始数第10位是学豆,从右边开始数他是第几位?


user: 0
输入之后,一直报matmul run failed

@waydong
Copy link
Collaborator

waydong commented Feb 24, 2025

你好,如warning所示,你npu驱动版本太低了,至少升级到0.9.7。

@pxrgod
Copy link
Author

pxrgod commented Feb 24, 2025

你好,如warning所示,你npu驱动版本太低了,至少升级到0.9.7。

那请问下这个driver版本我如何去生成或者获取?有没有说明?

@waydong
Copy link
Collaborator

waydong commented Feb 24, 2025

你好,如warning所示,你npu驱动版本太低了,至少升级到0.9.7。

那请问下这个driver版本我如何去生成或者获取?有没有说明?

请参考我们的文档。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants