Skip to content

[Conformance] SEP-2484: Wire SEP traceability files into conformance test runner; surface per-SEP pass rates #367

@chr-hertel

Description

@chr-hertel

Implements SEP-2484 for the MCP Spec 2026-07-28 release.

Tracked by umbrella #339.

Spec summary

Before any Standards Track SEP touching observable protocol behavior moves Accepted → Final, a tagged conformance scenario must be merged in the modelcontextprotocol/conformance repo with a sep-NNNN.yaml traceability file mapping each MUST/MUST NOT requirement.

PHP SDK changes

  • No direct code change, but materially affects how the SDK tracks SEP adoption. The conformance suite at tests/Conformance/ (Docker-based) becomes the ground truth for "feature implemented."
  • Use SEP traceability YAMLs to drive PHP coverage: each newly-Final SEP maps to a set of conformance scenarios that should pass against the PHP SDK before claiming support.
  • Build on commits f12ea0a (conformance score calculation) and 3e45b1f (README badges): surface per-SEP pass rates next to the overall score.
  • CI gate: when conformance suite adds a sep-NNNN.yaml, surface failures distinctly so adoption can be tracked SEP-by-SEP.

Related

Metadata

Metadata

Assignees

No one assigned

    Labels

    2026-07-28All issues and PRs related to the spec release 2026-07-28conformance-weeklyFindings while running the conformance test suite.enhancementRequest for a new feature that's not currently supportedimproves spec complianceImproves consistency with other SDKs such as TyepScript

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions