feat(pipeline): add wave-audit pipeline for implementation fidelity auditing#308
feat(pipeline): add wave-audit pipeline for implementation fidelity auditing#308nextlevelshit merged 1 commit intomainfrom
Conversation
…uditing Add a 4-step pipeline that audits closed issues and merged PRs against the current codebase to detect implementation gaps, regressions, and incomplete features. Steps: - collect-inventory: fetches closed issues/merged PRs via gh CLI - audit-items: static analysis verification with fidelity classification - compose-triage: aggregates findings into prioritized triage report - publish: creates GitHub issues for actionable findings Supports scoped audits (time range, label filters), resume via --from-step, and JSON schema contract validation on all step outputs. Closes #305
Code Review (Wave Pipeline)Verdict: REQUEST_CHANGES Solid pipeline design with clean DAG decomposition and good use of contract validation at every handover. Two issues should be fixed before merge; the rest are recommendations. Critical Issues1. Missing The publish step's handover contract defaults to soft failure. If the persona writes malformed JSON, the pipeline reports success with corrupt output. The analogous 2. The pipeline prompt and data model both treat Suggested ImprovementsSchema tightening (5 items, all straightforward):
Dependency hygiene —
Scalability — The Testing — No new tests cover schema validity or DAG resolution for this pipeline. A test that loads the YAML and validates each schema against example data would prevent regressions. Process — The three spec checklists ( Positive Observations
Generated by Wave gh-pr-review pipeline |
feat(pipeline): add wave-audit pipeline for implementation fidelity auditing
Summary
wave-auditpipeline definition (.wave/pipelines/wave-audit.yaml) with 4 steps: collect-inventory, audit-items, compose-triage, and publishghCLI to fetch closed issues/merged PRs, performs static analysis verification against HEAD, produces a prioritized triage report--from-step, and optional GitHub issue creation for actionable findingsnavigator/auditor); only the optionalpublishstep usescraftsmanSpec
See
specs/305-audit-pipeline/spec.mdfor the full feature specification including user stories, requirements, and success criteria.Test Plan
go test -race ./...passes with all tests greendoc-audit,wave-evolve)wave run wave-auditon a repository with closed issues to verify end-to-end flowKnown Limitations
Closes #305