Skip to content

Issues: airockchip/rknn-llm

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
115 Open 81 Closed
115 Open 81 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

有没有矩阵相乘的C代码demo示例，自己写的不知道为啥报错
#196 opened Feb 26, 2025 by wohaiaini
VLM模型的视觉rknn加载不了，failed to malloc npu memory, size: 1427746880
#195 opened Feb 26, 2025 by meiliu-c
rk3576 运行GPU程序示例demo代码？
#194 opened Feb 26, 2025 by wohaiaini
llama3-8B Seems slow and never end with new examples
#192 opened Feb 25, 2025 by openedev
板端如何使用异步推理
#190 opened Feb 25, 2025 by skiptomylou86
能否添加自定义算子？
#189 opened Feb 25, 2025 by wohaiaini
2
你好能否提供一下librkllmrt.so动态库的源码或者提供一下OpenHarmony平台的librkllmrt.so
#188 opened Feb 24, 2025 by yy438563755
2
使用DeepSeek-R1-Distill-Qwen-1.5B_W8A8_RK3588.rkllm进行推理时，选择第一个例子之后，一直报matmul run failed
#187 opened Feb 24, 2025 by pxrgod
3
W4A16 in rk3588s
#186 opened Feb 24, 2025 by ha-seungwon
2
RK3588安装rkllm-toolkit
#185 opened Feb 21, 2025 by wowotou958
1
能否实现兼容openai的API接口，方便调用
#184 opened Feb 21, 2025 by maxminx
ggml_calloc: failed to allocate 0.00 MB :0: fatal error when running DeepSeek on RK3676
#183 opened Feb 20, 2025 by AIWintermuteAI
1
Get device properities failed
#180 opened Feb 18, 2025 by HewelXX
1
Model conversion failed
#179 opened Feb 18, 2025 by Plwy
2
Qwen2.5-vl模型是否适配？
#178 opened Feb 17, 2025 by meijie-jesse
3
RK3588 Detian如何使用web端工具去访问DeepSeek-R1-Distill-Qwen-1.5B_W8A8_RK3588.rkllm模型
#176 opened Feb 17, 2025 by 3103570984
3
在RK3576上，使用examples/DeepSeek-R1-Distill-Qwen-1.5B_Demo/deploy源码编译得到的llm_demo运行时报错：Bus error
#175 opened Feb 15, 2025 by sunbeam1019
1
在RK3588上执行./llm models/Qwen2-VL-2B-Instruct.rkllm 128 512报错
#174 opened Feb 14, 2025 by YiRanNie
1
如何设置使得deepseek可以不输出/think推理过程，而直接输入答案
#173 opened Feb 14, 2025 by ziyiflying
1
[Inquiry] W4A16 and W8A8, Quantization technology
#172 opened Feb 14, 2025 by HarryBXie
ERROR: Catch exception when loading model: Error while deserializing header: HeaderTooLarge Load model failed!
#171 opened Feb 13, 2025 by usernamesfe
1
Support deepseek/Janus-Pro-1B
#170 opened Feb 13, 2025 by wingceltis-c Loading…
InternVL2.5-1B 适配过吗？
#169 opened Feb 12, 2025 by BUG1989
可以支持一下rk3566吗
#164 opened Feb 8, 2025 by Hphuang-hub
4
Feature Request: 请求添加类似 forward() 的API 以支持更灵活的推理和模型移植，例如 Deepseek Janus Pro
#161 opened Feb 2, 2025 by happyme531
1
ProTip! Updated in the last three days: updated:>2025-02-23.