-
Notifications
You must be signed in to change notification settings - Fork 67
Insights: airockchip/rknn-llm
Overview
-
0 Active pull requests
-
- 0 Merged pull requests
- 0 Open pull requests
- 4 Closed issues
- 10 New issues
There hasn’t been any commit activity on airockchip/rknn-llm in the last week.
Want to help out?
4 Issues closed by 4 people
-
rk3576推理报错read weight tensor size不一致问题
#193 closed
Feb 26, 2025 -
GGML_ASSERT:0 <= info->type && info->type < GGML_TYPE_COUNT
#191 closed
Feb 25, 2025 -
Qwen 模型转换, bos, eos 等 token 存在问题
#181 closed
Feb 21, 2025 -
Model execution fails on `llm-jp/llm-jp-3-1.8b-instruct`
#182 closed
Feb 20, 2025
10 Issues opened by 9 people
-
rk3576 运行GPU程序示例demo代码?
#194 opened
Feb 26, 2025 -
llama3-8B Seems slow and never end with new examples
#192 opened
Feb 25, 2025 -
板端如何使用异步推理
#190 opened
Feb 25, 2025 -
能否添加自定义算子?
#189 opened
Feb 25, 2025 -
你好能否提供一下librkllmrt.so动态库的源码或者提供一下OpenHarmony平台的librkllmrt.so
#188 opened
Feb 24, 2025 -
使用DeepSeek-R1-Distill-Qwen-1.5B_W8A8_RK3588.rkllm进行推理时,选择第一个例子之后,一直报matmul run failed
#187 opened
Feb 24, 2025 -
W4A16 in rk3588s
#186 opened
Feb 24, 2025 -
RK3588安装rkllm-toolkit
#185 opened
Feb 21, 2025 -
能否实现兼容openai的API接口,方便调用
#184 opened
Feb 21, 2025 -
ggml_calloc: failed to allocate 0.00 MB :0: fatal error when running DeepSeek on RK3676
#183 opened
Feb 20, 2025
3 Unresolved conversations
Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.
-
Qwen2.5-vl模型是否适配?
#178 commented on
Feb 21, 2025 • 0 new comments -
RK3588 Detian如何使用web端工具去访问DeepSeek-R1-Distill-Qwen-1.5B_W8A8_RK3588.rkllm模型
#176 commented on
Feb 21, 2025 • 0 new comments -
qwen2 vl gdq量化失败,报错 ERROR: Catch exception when Optimizing model: 'input'
#159 commented on
Feb 25, 2025 • 0 new comments