[None][perf] DSV4 multistream improvement for attention

[liji-nv]

@coderabbitai summary

Description

Test Coverage

PR Checklist

Please review the following before submitting your PR:

• PR description clearly explains what and why. If using CodeRabbit's summary, please make sure it makes sense.

• PR Follows TRT-LLM CODING GUIDELINES to the best of your knowledge.

• Test cases are provided for new code paths (see test instructions)

• Any new dependencies have been scanned for license and vulnerabilities

• CODEOWNERS updated if ownership changes

• Documentation updated as needed

• Update tava architecture diagram if there is a significant design change in PR.

• The reviewers assigned automatically/manually are appropriate for the PR.

• Please check this after reviewing the above items as appropriate for this PR.

GitHub Bot Help

To see a list of available CI bot commands, please comment /bot help.

[liji-nv]

/bot run

[tensorrt-cicd]

PR_Github #47913 [ run ] triggered by Bot. Commit: 892a334 Link to invocation

[tensorrt-cicd]

PR_Github #47913 [ run ] completed with state SUCCESS. Commit: 892a334
/LLM/main/L0_MergeRequest_PR pipeline #37760 completed with status: 'SUCCESS'

CI Report

Link to invocation

[liji-nv]

/bot run --add-multi-gpu-test --disable-fail-fast

[tensorrt-cicd]

PR_Github #47948 [ run ] triggered by Bot. Commit: 892a334 Link to invocation

[tensorrt-cicd]

PR_Github #47948 [ run ] completed with state SUCCESS. Commit: 892a334
/LLM/main/L0_MergeRequest_PR pipeline #37790 completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

• Please check the failed tests and fix your PR
• If you cannot view the failures, ask the CI triggerer to share details
• Once fixed, request an NVIDIA team member to trigger CI again

Link to invocation