feat(sovereign-ci): opt-in cargo nextest run (Phase 2 §4.3)#26
Merged
Conversation
Adds a new workflow_call boolean input `use_nextest` (default: false). When true, the test job uses `cargo nextest run --lib` instead of `cargo test --lib`. nextest is already installed in sovereign-ci:stable (Dockerfile line 39). Pattern mirrors enable_sccache opt-in rollout (PMAT-151): - opt-in with default false for safe pilot - pilots opt in via caller workflow's `with: use_nextest: true` - F11 falsifier will measure test-job p95 before/after on pilots - after 7 days, flip default true if p95 ≤ 300s Safety: if nextest fails for any reason (test harness quirks, workspace structure), fall back to cargo test with a warning annotation so CI doesn't break if a repo has incompatible test code. Baseline F11 on pilot repos (2026-04-18, limit=15 runs): copia n=15 p95=168s bashrs n=15 p95=222s aprender n=15 p95=449s fleet n=45 p95=446s (driven by aprender) Expected post-nextest: ~290s fleet p95 (35% reduction). Refs PMAT-155
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
workflow_callboolean inputuse_nextest(default:false) to the shared test job.cargo testwith a warning annotation.cargo-nextest --locked(Dockerfile line 39), so no additional deploy needed.Rollout pattern (mirrors PMAT-151 sccache)
ci.ymlwith: use_nextest: true.cargo run --example falsify_f11_test_job_p95).false → trueif F11 PASSES (p95 ≤ 300s).Baseline F11 (2026-04-18, limit=15)
Expected post-nextest: ~290s fleet p95 (35% reduction per nextest docs + Phase 2 §4.3).
Test plan
use_nextest: false(default) unchanged — all 20 non-pilot repos continue usingcargo testuse_nextest: trueverified on pilot repo CI runs once mergedRefs PMAT-155