Decode cudaErrorIllegalAddress

[lvmnn]

Version

0.4.0

Describe the bug.

In our Triton Inference Server service, we need to decode JPEG images in each request. After the service has been running for a period of time (a few days), we encounter the cudaErrorIllegalAddress error.

I checked the VRAM usage, it's using about 3GB in total of 15GB.

Minimum reproducible example

Environment details

Relevant log output

Other/Misc.

No response

Check for duplicates

• I have searched the open bugs/issues and have found no duplicates for this bug report

[jantonguirao]

Hi @lvmnn. Thank you for reporting this issue. Unfortunately, it is going to be hard for us to figure it out without a reproduction example.