Skip to content

Average multiple runs, and discard the outliers #11

@nfischer

Description

@nfischer

To get the most consistent results, we might do well to run each unit test multiple times, discard any outliers (maybe the system was in a weird state for one run), and average the remaining runs.

Doing a simple average is easy enough, and we'll see a huge amount of improvement that way, so it might be worth it to just write it in to do an average of 3-5 runs, and worry about outliers once they crop up.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions