Skip to content

feat(metrics): add agent performance tracking#28

Merged
NickStr11 merged 1 commit intomainfrom
feat/agent-metrics-1686202482711992418
Feb 24, 2026
Merged

feat(metrics): add agent performance tracking#28
NickStr11 merged 1 commit intomainfrom
feat/agent-metrics-1686202482711992418

Conversation

@NickStr11
Copy link
Copy Markdown
Owner

This PR introduces a new metrics tracking tool for AI agents (Jules and Codex).

Key features:

  • Fetches PR and linked Issue data using gh api graphql.
  • Calculates Success Rate (Merged / Total Finished).
  • Calculates Average Time to Merge (from Issue creation to PR merge).
  • Calculates Average Lines of Code per task.
  • Provides a breakdown by agents based on labels.
  • Adds a new /metrics slash command.

The tool is implemented in Python 3.12+ using uv, beartype, and follows the project's coding standards. Unit tests are included to verify the calculation logic.

Fixes #25


PR created automatically by Jules for task 1686202482711992418 started by @NickStr11

- Created tools/metrics/main.py to track agent performance (success rate, merge time, LOC) via GitHub GraphQL API.
- Added tools/metrics/pyproject.toml with dependencies and configurations.
- Implemented unit tests in tools/metrics/tests/test_metrics.py.
- Created .claude/commands/metrics.md for the /metrics slash command.
- Ensured 100% compliance with @beartype and type annotations.

Co-authored-by: NickStr11 <37849063+NickStr11@users.noreply.github.com>
@google-labs-jules
Copy link
Copy Markdown
Contributor

👋 Jules, reporting for duty! I'm here to lend a hand with this pull request.

When you start a review, I'll add a 👀 emoji to each comment to let you know I've read it. I'll focus on feedback directed at me and will do my best to stay out of conversations between you and other bots or reviewers to keep the noise down.

I'll push a commit with your requested changes shortly after. Please note there might be a delay between these steps, but rest assured I'm on the job!

For more direct control, you can switch me to Reactive Mode. When this mode is on, I will only act on comments where you specifically mention me with @jules. You can find this option in the Pull Request section of your global Jules UI settings. You can always switch back!

New to Jules? Learn more at jules.google/docs.


For security, I will only act on instructions from the user who triggered this task.

@NickStr11 NickStr11 merged commit 9430edd into main Feb 24, 2026
1 check passed
@NickStr11 NickStr11 deleted the feat/agent-metrics-1686202482711992418 branch March 5, 2026 04:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

feat(metrics): add agent performance tracking

1 participant