-
Notifications
You must be signed in to change notification settings - Fork 171
CI: Optimize and collect op_tests summaries #1731
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
ad611ee to
c129d65
Compare
c129d65 to
45f9361
Compare
4c1833b to
128263b
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Pull request overview
This PR optimizes performance summary outputs in test logs and introduces automated collection of these summaries in an easy-to-read markdown format for CI workflows.
Key changes:
- Converts pandas DataFrame summary outputs to markdown format using
to_markdown()across all operator test files - Adds a new Python script (
collect_logs.py) to extract and aggregate markdown summary blocks from test logs - Integrates the log collection script into the GitHub Actions workflow to display summaries in the workflow step summary
- Adds the
tabulatepackage dependency (required by pandasto_markdown()method)
Reviewed changes
Copilot reviewed 28 out of 28 changed files in this pull request and generated 3 comments.
Show a summary per file
| File | Description |
|---|---|
op_tests/test_topk_plain.py |
Refactored imports and converted summary output to markdown format |
op_tests/test_topk_per_row.py |
Converted two summary outputs (prefill and decode) to markdown format |
op_tests/test_smoothquant.py |
Converted three summary outputs to markdown format |
op_tests/test_sample.py |
Converted summary output to markdown format |
op_tests/test_quant.py |
Converted summary output to markdown format |
op_tests/test_pa_ps.py |
Converted summary output to markdown format |
op_tests/test_pa_mtp.py |
Converted summary output to markdown format |
op_tests/test_pa.py |
Converted summary output to markdown format |
op_tests/test_moe_sorting_mxfp4.py |
Converted two stage summary outputs to markdown format |
op_tests/test_moe_sorting.py |
Converted summary output to markdown format |
op_tests/test_moe_dp_share_expert.py |
Converted summary output to markdown format |
op_tests/test_moe_2stage.py |
Converted summary output to markdown format |
op_tests/test_moeTopkSoftmax.py |
Converted three summary outputs to markdown format |
op_tests/test_mla_sparse.py |
Converted summary output to markdown format |
op_tests/test_mla_persistent.py |
Converted summary output to markdown format |
op_tests/test_mla.py |
Converted summary output to markdown format |
op_tests/test_kvcache.py |
Converted summary output to markdown format |
op_tests/test_indexer_k_quant_and_cache.py |
Converted summary output to markdown format |
op_tests/test_gemm_a8w8_blockscale.py |
Converted summary output to markdown format |
op_tests/test_gemm_a8w8.py |
Converted summary output to markdown format |
op_tests/test_gemm_a4w4.py |
Converted summary output to markdown format |
op_tests/test_gemm_a16w16.py |
Converted summary output to markdown format |
op_tests/test_deepgemm.py |
Converted summary output to markdown format |
op_tests/test_concat_cache_mla.py |
Converted two summary outputs to markdown format |
op_tests/test_activation.py |
Converted two summary outputs to markdown format |
.github/workflows/aiter-test.yaml |
Added log collection step to extract and display markdown summaries in workflow output |
.github/scripts/collect_logs.py |
New script that parses log files to extract markdown-formatted summary tables |
.github/scripts/build_aiter_triton.sh |
Added tabulate package installation (required for pandas markdown conversion) |
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
* CI: Optimize and collect op_tests summaries * fix * Update op_tests/test_topk_plain.py Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> * convert to makrdown * Add collect_logs.py * Update op_tests/test_smoothquant.py Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> --------- Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Related to https://github.com/orgs/ROCm/projects/48/views/1?filterQuery=sprint%3A%40current+assignee%3A%22gyohuangxin%22&pane=issue&itemId=120791567&issue=ROCm%7Cframeworks-internal%7C12994