Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
37 commits
Select commit Hold shift + click to select a range
bd140a8
Optimize CI for wolfProvider
aidangarske May 27, 2026
5cc29e4
ci: smoke-test - grant packages:read so reusable discover_versions ca…
aidangarske May 27, 2026
d01bf2e
ci: use test-deps container for sanitizers, static-analysis, libnice
aidangarske May 27, 2026
212fa72
ci: shrink multi-compiler PR matrix, move full coverage to nightly
aidangarske May 27, 2026
f0cd51d
ci: add jq to test-deps image
aidangarske May 27, 2026
154312b
ci: sanitizers - shell:bash for steps that use 'source'
aidangarske May 27, 2026
541dc3c
ci: drop libunwind-dev from test-deps image - conflicts with libunwin…
aidangarske May 27, 2026
05b1491
ci: multi-compiler - dump build-release.log on failure
aidangarske May 27, 2026
cedc668
ci: add gcc-11/12 and clang-13/15 to test-deps for multi-compiler
aidangarske May 27, 2026
4bf24af
scripts: add resolve-osp-patch.sh for wolfssl-version-aware OSP patch…
aidangarske May 27, 2026
4041b03
ci: route OSP patch lookup through resolve-osp-patch.sh
aidangarske May 27, 2026
63a20e8
ci: add wolfssl_refs_json input + split nightly-osp into Wave 1 / Wave 2
aidangarske May 27, 2026
964f8c0
ci: keep nightly Wave 1 dynamic (drop hardcoded v5.9.1-stable)
aidangarske May 27, 2026
b1104de
Merge aidan/v5.8.4-osp-support into ci-draft-pause
aidangarske May 27, 2026
3d61947
ci: stunnel - drop --fips (OSP now ships one patch for both)
aidangarske May 28, 2026
5d35724
ci: resolver falls back to non-FIPS patch when no FIPS-specific one e…
aidangarske May 28, 2026
af41abc
ci: simplify OSP patch resolver + pass --fips uniformly
aidangarske May 28, 2026
e97d2ed
ci: build-wolfprovider pulls the wolfSSL deb pinned to wolfssl_ref
aidangarske May 28, 2026
8ce085d
TEMP(testing): checkout aidangarske/osp@5.9.1-wolfprov-patches for OS…
aidangarske May 28, 2026
b120a82
TEMP(testing): trigger nightly-osp on push to ci-draft-pause
aidangarske May 28, 2026
b8bacb2
ci: fix GHA expression string quoting (wolfssl_refs_json != '')
aidangarske May 28, 2026
1fcc235
TEMP(testing): re-trigger nightly-osp to validate 5.8.4 patch fix
aidangarske May 28, 2026
1170d08
ci: add AI-triaged OSP health report
aidangarske May 28, 2026
b663e54
ci: strip ANTHROPIC_API_KEY whitespace; stop report pushes re-trigger…
aidangarske May 28, 2026
e9de472
ci: cleaner OSP report — accurate AI, severity by pass-rate
aidangarske May 28, 2026
f9234ef
ci: richer OSP report — severity tiers, links, per-failure notes
aidangarske May 28, 2026
2c007c3
ci: severity meter, breakdown line, trend sparkline
aidangarske May 28, 2026
2c3da97
ci: xmlsec build_wolfprovider needs discover_versions
aidangarske May 28, 2026
8ce88e5
ci: report emojis only on the breakdown line
aidangarske May 28, 2026
14f0765
ci: run-scope static-analysis concurrency so nightly runs don't cance…
aidangarske May 28, 2026
0e106f7
ci: drop osp-report push trigger; report only on run completion
aidangarske May 28, 2026
dd7da1e
ci: one-shot OSP report against validation run 26607404315
aidangarske May 29, 2026
0576058
ci: productionize OSP nightly + report for merge
aidangarske May 29, 2026
f0eabf9
ci: trigger PRB to validate new preflight (no smoke wait) + dep cache
aidangarske May 29, 2026
7ba43f4
ci: retrigger PRB - now with inlined cache logic (no external helper)
aidangarske May 29, 2026
699a53a
ci: add v5.8.4-stable to PR-time matrix (supported back-compat line)
aidangarske May 29, 2026
39e0d14
ci: retrigger PR #400 after testing PR #958 cache revert
aidangarske May 30, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
273 changes: 273 additions & 0 deletions .github/README.md

Large diffs are not rendered by default.

95 changes: 95 additions & 0 deletions .github/actions/wait-for-smoke/action.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,95 @@
name: 'Wait for Smoke Test'
description: 'Polls the Smoke Test workflow for the current commit and fails if it failed.'

# Designed to be the leading job in pull_request-triggered workflows so that
# expensive integration CI does not run unless the smoke build passes.
#
# Push events bypass the wait entirely (we still get smoke results for those
# pushes, but other CI is not gated on push). For drafts, callers should
# skip dependent jobs via `if: github.event.pull_request.draft == false` -
# this action will still pass through if smoke is skipped or absent.

inputs:
workflow:
description: 'Name of the smoke workflow file to wait on'
required: false
default: 'smoke-test.yml'
timeout-seconds:
description: 'Maximum time to wait for smoke to complete'
required: false
default: '1800'
poll-seconds:
description: 'Polling interval'
required: false
default: '20'
github-token:
description: 'GITHUB_TOKEN with actions:read permission'
required: true

runs:
using: 'composite'
steps:
- name: Wait for smoke
shell: bash
env:
GH_TOKEN: ${{ inputs.github-token }}
SMOKE_WORKFLOW: ${{ inputs.workflow }}
TIMEOUT: ${{ inputs.timeout-seconds }}
POLL: ${{ inputs.poll-seconds }}
REPO: ${{ github.repository }}
run: |
set -u
# Only gate pull_request events. Push events are not gated.
if [ "${{ github.event_name }}" != "pull_request" ]; then
echo "Not a pull_request event - skipping smoke gate."
exit 0
fi

HEAD_SHA="${{ github.event.pull_request.head.sha }}"
echo "Waiting for $SMOKE_WORKFLOW on $HEAD_SHA (timeout ${TIMEOUT}s)"

START=$(date +%s)
while :; do
NOW=$(date +%s)
ELAPSED=$((NOW - START))
if [ "$ELAPSED" -ge "$TIMEOUT" ]; then
echo "::error::Timed out after ${TIMEOUT}s waiting for $SMOKE_WORKFLOW on $HEAD_SHA"
exit 1
fi

# Look up the latest run for this workflow + head SHA.
RUN_JSON=$(gh api \
"repos/${REPO}/actions/workflows/${SMOKE_WORKFLOW}/runs?head_sha=${HEAD_SHA}&per_page=1" \
2>/dev/null || echo '{}')

STATUS=$(echo "$RUN_JSON" | jq -r '.workflow_runs[0].status // "missing"')
CONCLUSION=$(echo "$RUN_JSON" | jq -r '.workflow_runs[0].conclusion // ""')
RUN_URL=$(echo "$RUN_JSON" | jq -r '.workflow_runs[0].html_url // ""')

case "$STATUS" in
completed)
case "$CONCLUSION" in
success)
echo "Smoke test passed: $RUN_URL"
exit 0
;;
skipped|neutral)
echo "Smoke test was $CONCLUSION - treating as pass: $RUN_URL"
exit 0
;;
*)
echo "::error::Smoke test concluded as '$CONCLUSION': $RUN_URL"
exit 1
;;
esac
;;
missing)
echo "[$ELAPSED s] No smoke run yet for $HEAD_SHA"
;;
*)
echo "[$ELAPSED s] Smoke status=$STATUS ($RUN_URL)"
;;
esac

sleep "$POLL"
done
62 changes: 8 additions & 54 deletions .github/scripts/check-workflow-result.sh
Original file line number Diff line number Diff line change
Expand Up @@ -41,62 +41,16 @@ fi
if [ "$WOLFPROV_FORCE_FAIL" = "WOLFPROV_FORCE_FAIL=1" ]; then
# ----- CURL -----
if [ "$TEST_SUITE" = "curl" ]; then
if [ -f "curl-test.log" ]; then
# Extract and clean the failed test list from the log
ACTUAL_FAILS=$(grep -a '^TESTFAIL: These test cases failed:' curl-test.log | sed 's/.*failed: //')
else
echo "Error: curl-test.log not found"
exit 1
fi

# Get curl version from the workflow ref
CURL_VERSION="${CURL_REF:-}"

# Define expected failures based on curl version
case "$CURL_VERSION" in
"curl-7_88_1")
EXPECTED_FAILS="9 39 41 44 64 65 70 71 72 88 153 154 158 163 166 167 168 169 170 173 186 206 245 246 258 259 273 277 327 335 388 540 551 552 554 565 579 584 643 645 646 647 648 649 650 651 652 653 654 666 667 668 669 670 671 672 673 1001 1002 1030 1053 1060 1061 1071 1072 1079 1095 1133 1136 1158 1186 1187 1189 1190 1191 1192 1193 1194 1195 1196 1198 1199 1229 1284 1285 1286 1293 1315 1404 1412 1418 1437 1568 1905 1916 1917 2024 2026 2027 2028 2030 2058 2059 2060 2061 2062 2063 2064 2065 2066 2067 2068 2069 2073 2076 2200 2201 2202 2203 2204 3017 3018"
;;
"curl-8_4_0")
EXPECTED_FAILS="9 31 39 41 44 46 61 64 65 70 71 72 73 88 153 154 158 163 166 167 168 169 170 171 173 186 206 245 246 258 259 273 277 327 335 388 420 444 540 551 552 554 565 579 584 643 645 646 647 648 649 650 651 652 653 654 666 667 668 669 670 671 672 673 977 1001 1002 1030 1053 1060 1061 1071 1072 1079 1095 1105 1133 1136 1151 1155 1158 1160 1161 1186 1187 1189 1190 1191 1192 1193 1194 1195 1196 1198 1199 1229 1284 1285 1286 1293 1315 1404 1412 1415 1418 1437 1568 1903 1905 1916 1917 1964 2024 2026 2027 2028 2030 2058 2059 2060 2061 2062 2063 2064 2065 2066 2067 2068 2069 2073 2076 2200 2201 2202 2203 2204 3017 3018"
;;
"master")
EXPECTED_FAILS="9 31 39 41 44 46 61 64 65 70 71 72 73 88 153 154 158 163 166 167 168 169 170 171 173 186 206 245 246 258 259 273 277 327 335 388 420 444 483 540 551 552 554 565 579 584 643 645 646 647 648 649 650 651 652 653 654 666 667 668 669 670 671 672 673 695 977 1001 1002 1030 1053 1060 1061 1071 1072 1079 1095 1105 1133 1136 1151 1155 1158 1160 1161 1186 1187 1189 1190 1191 1192 1193 1194 1195 1196 1198 1199 1229 1284 1285 1286 1293 1315 1404 1412 1415 1418 1437 1476 1568 1608 1610 1615 1654 1660 1903 1905 1916 1917 1964 2024 2026 2027 2028 2030 2058 2059 2060 2061 2062 2063 2064 2065 2066 2067 2068 2069 2073 2076 2200 2201 2202 2203 2204 3017 3018"
;;
*)
echo "Error: Unknown curl version: $CURL_VERSION"
exit 1
;;
esac

# Create temporary files for sorted lists
TEMP_DIR=$(mktemp -d)
ACTUAL_SORTED="${TEMP_DIR}/actual_sorted.txt"
EXPECTED_SORTED="${TEMP_DIR}/expected_sorted.txt"

# Clean and sort both lists and remove empty lines
echo "$ACTUAL_FAILS" | tr ' ' '\n' | grep -v '^$' | sort -n > "$ACTUAL_SORTED"
echo "$EXPECTED_FAILS" | tr ' ' '\n' | grep -v '^$' | sort -n > "$EXPECTED_SORTED"

echo "DEBUG: Sorted actual fails: $(tr '\n' ' ' < "$ACTUAL_SORTED")"
echo "DEBUG: Sorted expected fails: $(tr '\n' ' ' < "$EXPECTED_SORTED")"

# Find missing in actual (in expected but not in actual)
MISSING=$(comm -23 "$EXPECTED_SORTED" "$ACTUAL_SORTED" | tr '\n' ' ')
# Find extra in actual (in actual but not in expected)
EXTRA=$(comm -13 "$EXPECTED_SORTED" "$ACTUAL_SORTED" | tr '\n' ' ')

# Clean up temporary files
rm -rf "$TEMP_DIR"

echo "Test(s) that should have failed: $MISSING"
echo "Test(s) that shouldn't have failed: $EXTRA"

if [ -z "$MISSING" ] && [ -z "$EXTRA" ]; then
echo "PASS: Actual failed tests match expected."
# Under WOLFPROV_FORCE_FAIL=1, wolfProvider deliberately errors on
# every call, so the curl test-suite is expected to fail somewhere.
# We just need a non-zero exit code; the exact list of failing test
# numbers will drift across curl versions / suite updates and is not
# worth pinning. If make test-ci returned non-zero, treat as pass.
if [ "$TEST_RESULT" -ne 0 ]; then
echo "PASS: curl tests failed (exit $TEST_RESULT) as expected under WOLFPROV_FORCE_FAIL=1"
exit 0
else
echo "FAIL: Actual failed tests do not match expected."
echo "FAIL: curl tests unexpectedly succeeded under WOLFPROV_FORCE_FAIL=1"
exit 1
fi
# ----- OPENVPN -----
Expand Down
Loading
Loading