CUDA 13 Linux aarch64 onnxruntime-gpu python package available for testing

[tianleiwu]

This package is built with

• CUDA 13.1.1
• TensortRT 10.15.1
• CuDNN 9.17.1.4
• NCCL 2.29.3

Python Packages

CUDA 13: https://aiinfra.visualstudio.com/PublicPackages/_artifacts/feed/ort-cuda-13-nightly/PyPI/onnxruntime-gpu/overview/1.25.0.dev20260331005

Installation

First, you might need uninstall existed onnx runtime packages, and install required packages like

pip uninstall onnxruntime onnxruntime-gpu -y
pip install flatbuffers numpy packaging protobuf sympy

onnxruntime-gpu for CUDA 13.x

pip install --pre --index-url https://aiinfra.pkgs.visualstudio.com/PublicPackages/_packaging/ort-cuda-13-nightly/pypi/simple/ onnxruntime-gpu==1.25.0.dev20260331005

Notes

Note that it uses manylinux_2_34 instead of manylinux_2_28. So it requires newer OS systems (RHEL 9 / Ubuntu 22.04+).

[Kaweees]

This is huge, thank you for adding this!