-
Notifications
You must be signed in to change notification settings - Fork 1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Arithmetic exception on old AMD dual-core CPU #2716
Comments
@grialion could you provide more specific reproduce steps and corresponding lib versions? e.g., |
Hi @grialion |
Looks like Xbyak fails to detect number of cores or cache size on this processor and dies in this function. To be fair this processor is over 15 years old... |
If you want to make oneDNN work on this processor please work with @herumi to fix the issue in upstream Xbyak. We'll propagate the changes to oneDNN and further downstream. And thanks for the detailed report! |
Running it with
Yes, I'd like to make it work, however I would like to use the computation-heavy parts on my GPU. Is it possible to off-load the work to the GPU instead of using oneDNN on the CPU? If it's not an option, I'd help making this CPU supported. |
It looks like Open WebUI is using Pytorch under the hood, so you should be able to run your model on GPU as well. Discussion on how to do that probably belongs at Open WebUI specific forum.
Xbyak is a header-only library that implements certain functionality oneDNN relies on. The floating point exception you see is thrown by an Xbyak function. My guess that AMD-specific code for hardware capabilities detection does not work correctly on your particular processor. |
HI @grialion I couldn't reproduce this issue on my end with Intel CPU/GPUs. |
Summary
I'm trying to get Open-WebUI running on my old AMD Athlon dual-core server.
DNNL crashes with exit code 136.
GDB shows that it crashed in the dnnl library.
Version
I was not able to get any logs using the environment variable
ONEDNN_VERBOSE=all /path/to/python /path/to/open-webui serve
However the project seems to have torch v2.5.1 pinned.
Environment
lscpu output:
Steps to reproduce
Start Open-WebUI on a dual-core Athlon CPU, e.g
uvx --python 3.11 open-webui@latest serve
.dnnl::impl::cpu::x64::get_effective_cpu_isa
is eventually called, leading to the arithmetic exception.Observed behavior
After starting the web application, it crashes with
exit code 136
.Using bash, it shows
Floating point exception (core dumped)
.This is the application output:
Here's the coredumpctl log:
Using gdb to view the backtrace, I see the following error:
Here is the truncated backtrace:
The text was updated successfully, but these errors were encountered: