Running on AMD gpu on Windows without installing the full SDK #194
DGdev91
started this conversation in
Show and tell
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
The ROCm version of KoboldCpp (https://github.com/YellowRoseCx/koboldcpp-rocm) copies it's runtime libs in a temporary folder called "_MEI" + some nubers, placed in C:\Users\username\AppData\Local\Temp. In those libs there are also hipblas.dll, rocblas.dll, and a "library" folder containing ROCm's tensile library files, and this allows it to run on amd gpus without the need of having the SDK installed.
I just checked, and this works just fine for stablediffussion.cpp too. just copy those libs from koboldcpp's temp folder and place it in the same place as sd.exe
Maybe i can also be a good idea shipping those libs in the rocm windows build
Beta Was this translation helpful? Give feedback.
All reactions