Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add onnxruntime 1.18.1 for Linux aarch64 GPU #1914

Merged
merged 1 commit into from
Feb 24, 2025

Conversation

csukuangfj
Copy link
Collaborator

See also #1630

The pre-built onnxruntime libs are provided by the community using the following command:

./build.sh --build_shared_lib --config Release --update \
  --build --parallel --use_cuda \
  --cuda_home /usr/local/cuda \
  --cudnn_home /usr/lib/aarch64-linux-gnu 2>&1 | tee my-log.txt

See also microsoft/onnxruntime#11226

info about the board:

Software part of jetson-stats 4.3.1 - (c) 2024, Raffaello Bonghi
Model: NVIDIA Jetson Orin Nano Engineering Reference Developer Kit Super - Jetpack 6.2 [L4T 36.4.3]
NV Power Mode[1]: 25W
Serial Number: [XXX Show with: jetson_release -s XXX]
Hardware:
 - P-Number: p3767-0003
 - Module: NVIDIA Jetson Orin Nano (8GB ram)
Platform:
 - Distribution: Ubuntu 22.04 Jammy Jellyfish
 - Release: 5.15.148-tegra
jtop:
 - Version: 4.3.1
 - Service: Active
Libraries:
 - CUDA: 12.6.68
 - cuDNN: 9.3.0.75
 - TensorRT: 10.3.0.30
 - VPI: 3.2.4
 - Vulkan: 1.3.204
 - OpenCV: 4.8.0 - with CUDA: NO

Build logs are attached below
build_log.txt


You can try the pre-built binaries and libs for v1.10.45 at
https://huggingface.co/csukuangfj/sherpa-onnx-libs/blob/main/aarch64/sherpa-onnx-v1.10.45-linux-aarch64-shared-gpu-onnxruntime-1.18.1.tar.bz2

Screenshot 2025-02-24 at 16 11 15

@csukuangfj csukuangfj merged commit bafd110 into k2-fsa:master Feb 24, 2025
165 of 210 checks passed
@csukuangfj csukuangfj deleted the linux-aarch64-gpu-1.18.1 branch February 24, 2025 08:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant