Skip to content

Comments

Regression testing module improvements#19

Merged
LiamPattinson merged 7 commits intomainfrom
regression_new
Feb 17, 2026
Merged

Regression testing module improvements#19
LiamPattinson merged 7 commits intomainfrom
regression_new

Conversation

@avadean
Copy link
Collaborator

@avadean avadean commented Feb 17, 2026

Overhaul of the regression testing module

  • Introduction gives motivation and explanation
  • Manual example
  • Snaptol example
  • Snaptol with floating point number tolerance example
  • 3 exercises of increasing difficulty

Fixes #4

…testing via an example of a manual test to illustrate the idea and the fallbacks of doing it manually. Then introduces Snaptol to automate the file management process, as well as introduce the capability of tolerances on comparisons involving floating point numbers. Introduce 3 exercises of increasing difficulty, along with solutions.
…loating point numbers explanation. This builds on the previous Floating Point Numbers module.
@github-actions
Copy link

github-actions bot commented Feb 17, 2026

Thank you!

Thank you for your pull request 😃

🤖 This automated message can help you check the rendered files in your submission for clarity. If you have any questions, please feel free to open an issue in {sandpaper}.

If you have files that automatically render output (e.g. R Markdown), then you should check for the following:

  • 🎯 correct output
  • 🖼️ correct figures
  • ❓ new warnings
  • ‼️ new errors

Rendered Changes

🔍 Inspect the changes: https://github.com/ResearchCodingClub/python-testing-for-research/compare/md-outputs..md-outputs-PR-19

The following changes were observed in the rendered markdown documents:

 09-testing-output-files.md | 469 +++++++++++++++++++++++++++++++++------------
 md5sum.txt                 |   2 +-
 2 files changed, 343 insertions(+), 128 deletions(-)
What does this mean?

If you have source files that require output and figures to be generated (e.g. R Markdown), then it is important to make sure the generated figures and output are reproducible.

This output provides a way for you to inspect the output in a diff-friendly manner so that it's easy to see the changes that occur due to new software versions or randomisation.

⏱️ Updated at 2026-02-17 15:59:19 +0000

# Conflicts:
#	learners/setup.md
github-actions bot pushed a commit that referenced this pull request Feb 17, 2026
Copy link
Collaborator

@LiamPattinson LiamPattinson left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @avadean, this all looks good to me!

@LiamPattinson LiamPattinson merged commit 90fb03c into main Feb 17, 2026
3 checks passed
github-actions bot pushed a commit that referenced this pull request Feb 17, 2026
Auto-generated via `{sandpaper}`
Source  : 90fb03c
Branch  : main
Author  : Liam Pattinson <LiamPattinson@users.noreply.github.com>
Time    : 2026-02-17 16:37:37 +0000
Message : Merge pull request #19 from ResearchCodingClub/regression_new

Regression testing module improvements
github-actions bot pushed a commit that referenced this pull request Feb 17, 2026
Auto-generated via `{sandpaper}`
Source  : ccb5d0a
Branch  : md-outputs
Author  : GitHub Actions <actions@github.com>
Time    : 2026-02-17 16:38:54 +0000
Message : markdown source builds

Auto-generated via `{sandpaper}`
Source  : 90fb03c
Branch  : main
Author  : Liam Pattinson <LiamPattinson@users.noreply.github.com>
Time    : 2026-02-17 16:37:37 +0000
Message : Merge pull request #19 from ResearchCodingClub/regression_new

Regression testing module improvements
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Overhaul regression testing and plots

2 participants