Skip to content

Filter nonfinite calibration references#2262

Merged
FlorianPfaff merged 3 commits into
mainfrom
codex/calibration-reference-finite
May 25, 2026
Merged

Filter nonfinite calibration references#2262
FlorianPfaff merged 3 commits into
mainfrom
codex/calibration-reference-finite

Conversation

@FlorianPfaff
Copy link
Copy Markdown
Owner

Summary

  • Ignore non-finite reference timestamps and reference-value rows before timestamp interpolation.
  • Make nearest-time matching consider only finite reference timestamps while preserving original indices.
  • Apply the same usable-reference filtering to bias calibration examples.
  • Add regression coverage for non-finite reference rows in time-offset and bias calibration.

Rationale

Calibration data can contain dropped samples encoded as NaN/inf timestamps or values. The previous implementation sorted these rows into the reference trajectory and let them participate in interpolation or nearest-neighbor matching, which could silently invalidate good query samples or choose unusable reference rows. The patch filters unusable reference rows first and fails only when too few finite rows remain for interpolation.

Validation

  • Added focused tests in tests/calibration/test_time_offset_bias.py.
  • Full local pytest could not be run because this execution container cannot resolve github.com; repository CI should run the focused calibration tests and the full suite.

@FlorianPfaff FlorianPfaff enabled auto-merge (squash) May 25, 2026 16:33
@github-actions
Copy link
Copy Markdown
Contributor

MegaLinter analysis: Success

Descriptor Linter Files Fixed Errors Warnings Elapsed time
✅ COPYPASTE jscpd yes no no 49.36s
✅ JSON prettier 7 0 0 0 1.1s
✅ JSON v8r 7 0 0 4.73s
✅ MARKDOWN markdownlint 66 0 0 0 1.92s
✅ MARKDOWN markdown-table-formatter 66 0 0 0 0.68s
✅ PYTHON black 765 3 0 0 41.69s
✅ PYTHON isort 765 3 0 0 8.23s
✅ REPOSITORY checkov yes no no 47.61s
✅ REPOSITORY gitleaks yes no no 11.98s
✅ REPOSITORY git_diff yes no no 0.07s
✅ REPOSITORY secretlint yes no no 22.87s
✅ REPOSITORY syft yes no no 5.38s
✅ REPOSITORY trivy-sbom yes no no 6.85s
✅ REPOSITORY trufflehog yes no no 24.46s
✅ YAML prettier 11 0 0 0 0.77s
✅ YAML v8r 11 0 0 11.61s
✅ YAML yamllint 11 0 0 0.6s

Notices

📣 MegaLinter 9.5.0 is out! Discover the new features and security recommendations in the release announcement. (Skip this info by defining SECURITY_SUGGESTIONS: false)

See detailed reports in MegaLinter artifacts

Your project could benefit from a custom flavor, which would allow you to run only the linters you need, and thus improve runtime performances. (Skip this info by defining FLAVOR_SUGGESTIONS: false)

  • Documentation: Custom Flavors
  • Command: npx mega-linter-runner@9.5.0 --custom-flavor-setup --custom-flavor-linters PYTHON_BLACK,PYTHON_ISORT,COPYPASTE_JSCPD,JSON_V8R,JSON_PRETTIER,MARKDOWN_MARKDOWNLINT,MARKDOWN_MARKDOWN_TABLE_FORMATTER,REPOSITORY_CHECKOV,REPOSITORY_GIT_DIFF,REPOSITORY_GITLEAKS,REPOSITORY_SECRETLINT,REPOSITORY_SYFT,REPOSITORY_TRIVY_SBOM,REPOSITORY_TRUFFLEHOG,YAML_PRETTIER,YAML_YAMLLINT,YAML_V8R

MegaLinter is graciously provided by OX Security
Show us your support by starring ⭐ the repository

@FlorianPfaff FlorianPfaff merged commit 8c5ebee into main May 25, 2026
25 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant