feat(runtime): support binding TRTEngine execution to an external CUDA stream#4232

Open

shoumikhin wants to merge 10 commits intopytorch:mainfrom

shoumikhin:green-context-external-stream-upstream

Commits on May 4, 2026

feat(runtime): support binding TRTEngine execution to an external CUDA stream

shoumikhin
authored and
shoumikhin
committed
Reorder import statements in test file
shoumikhin
committed
Fix exception assertion in external stream test
shoumikhin
committed
fixup(runtime): address review feedback for external stream binding

shoumikhin
authored and
shoumikhin
committed
lint: collapse TORCHTRT_CHECK to one line per clang-format
shoumikhin
committed
fixup: address review feedback - Python runtime passthrough + symmetry
shoumikhin
committed
fixup: use cudaStreamGetDevice (runtime API) instead of driver API to avoid libcuda link on Jetpack
shoumikhin
committed
fixup: passthrough provenance, Python cudagraphs guard, CUDART<12.5 warning
shoumikhin
committed
lint: clang-format LOG_WARNING split + black-reformat assert statements
shoumikhin
committed
fix(jetpack): bump cudaStreamGetDevice guard to 12.8 + exclude aarch64
shoumikhin
committed