Problem Statement
With the fix for issue #309, leaderboard submissions can now include assessments with fewer than 25 attributes (when --exclude is used). However, users viewing the leaderboard have no way to know if a submission used exclusions, making it difficult to compare scores fairly.
Proposed Solution
Add a visual indicator on the leaderboard UI to show when a submission has excluded attributes. This could be:
- A badge or icon next to the score (e.g., "22/25 attributes")
- A tooltip explaining which attributes were excluded
- A filter option to show only full assessments (25/25)
Alternatives Considered
- Reject exclusions for leaderboard — Too restrictive; some attributes may not apply to all projects
- Separate leaderboards — Full vs. partial assessments; adds complexity
- Score normalization — Adjust scores based on attributes assessed; could be misleading
Use Cases
- User wants to compare their full assessment against others and filter out partial submissions
- User wants to understand why a project has a high score with fewer attributes
- Maintainer wants to identify trends in which attributes are commonly excluded
Additional Context
Related to issue #309 (schema validation fix) which enabled partial assessments to be submitted.
The attributes_total and attributes_assessed fields are already present in the assessment JSON, so no data changes are needed — only UI updates.
Acceptance Criteria
Priority
Problem Statement
With the fix for issue #309, leaderboard submissions can now include assessments with fewer than 25 attributes (when
--excludeis used). However, users viewing the leaderboard have no way to know if a submission used exclusions, making it difficult to compare scores fairly.Proposed Solution
Add a visual indicator on the leaderboard UI to show when a submission has excluded attributes. This could be:
Alternatives Considered
Use Cases
Additional Context
Related to issue #309 (schema validation fix) which enabled partial assessments to be submitted.
The
attributes_totalandattributes_assessedfields are already present in the assessment JSON, so no data changes are needed — only UI updates.Acceptance Criteria
Priority