Feature/repeat flag#56
Open
vincent5678 wants to merge 6 commits into
Open
Conversation
…ace into feature/repeat-flag
KaykCaputo
requested changes
Apr 23, 2026
Owner
KaykCaputo
left a comment
There was a problem hiding this comment.
I like the approach, we just need to get the tests passing.
Merging this will make it much easier for me to implement the warmup feature.
KaykCaputo
requested changes
Apr 24, 2026
Owner
KaykCaputo
left a comment
There was a problem hiding this comment.
Actually, we should use the median instead of the average for these calculations. In a benchmarking context, the median is much more resilient to outliers—like random spikes in CI resource usage—providing far greater precision and reliability for our users.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Add repeat flag to aggregate trace results on repeated runs
Related Issue
Link the related issue if available.
Implements #18
Type of Change
What Changed
List the key changes in a few bullets.
Validation
Describe how you validated this change.
CLI smoke check
Functional trace run
JSON export and compare flow
CSV, ignore, and top flags
oracletrace your_script.py --csv trace.csv oracletrace your_script.py --ignore "helper_function,debug_*" oracletrace your_script.py --top 10Docs build (if docs changed)
Checklist
Before/After Output (if applicable)
Include relevant CLI output snippets when behavior or formatting changed.
Before
After
Additional Notes
Function results become the average of results. For example:
call_count becomes the average amount of times this function is called per run. total_time becomes the average of total time the function spends in each run. avg_time is still the avg_time the individual function takes to run