-
Notifications
You must be signed in to change notification settings - Fork 3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
A bug occurs when the program terminates #15174
Comments
Can you try the latest version of ORT? We've not seen reports of this behavior. So, detailed instructions on how to repro will be required. |
Using the code from the latest main today, I could not reproduce this issue. |
Hello, I'm a member of MaaAssistantArknights, and it occurs on our program as the same. Onnxruntime version: 1.15.1 with prebuild https://github.com/microsoft/onnxruntime/releases/download/v1.15.1/onnxruntime-linux-x64-gpu-1.15.1.tgz Exception:
core dump:
For more technical details:
Could it be caused by that, each |
Meet the same problem. Program ends with: terminate called after throwing an instance of 'onnxruntime::OnnxRuntimeException' onnxruntime version is onnxruntime-linux-x64-gpu-1.12.0 |
onnxruntime-linux-x64-gpu-1.16.3 meets the same problem. |
Debugging with breakpoints on Long text
Note that |
I also encountered a similar problem, ORT should have a global variable inside, which was released early, resulting in the corresponding data can not be found when cudaFreeHost. |
i meet the same error and solve it now |
Describe the issue
It works well when it run in GPU,but it has a bug when it terminates
terminate called after throwing an instance of 'onnxruntime::OnnxRuntimeException'
what(): /onnxruntime_src/onnxruntime/core/providers/cuda/cuda_call.cc:122 bool onnxruntime::CudaCall(ERRTYPE, const char*, const char*, ERRTYPE, const char*) [with ERRTYPE = cudaError; bool THRW = true] /onnxruntime_src/onnxruntime/core/providers/cuda/cuda_call.cc:116 bool onnxruntime::CudaCall(ERRTYPE, const char*, const char*, ERRTYPE, const char*) [with ERRTYPE = cudaError; bool THRW = true] CUDA failure 4: driver shutting down ; GPU=806358777 ; hostname=lv-voice-rt-02 ; expr=cudaEventSynchronize(e);
To reproduce
Urgency
No response
Platform
Linux
OS Version
centos
ONNX Runtime Installation
Released Package
ONNX Runtime Version or Commit ID
1.12.1
ONNX Runtime API
C++
Architecture
X64
Execution Provider
CUDA
Execution Provider Library Version
CUDA 11.4
The text was updated successfully, but these errors were encountered: