Skip to content

Fix cost attribution edge cases#30

Closed
orban wants to merge 2 commits intonightshift/bus-factorfrom
cost-attribution-fix2
Closed

Fix cost attribution edge cases#30
orban wants to merge 2 commits intonightshift/bus-factorfrom
cost-attribution-fix2

Conversation

@orban
Copy link
Copy Markdown
Owner

@orban orban commented Apr 4, 2026

Summary

  • preserve skill-generation cost attribution on repo-task timeout and empty-run returns
  • recompute resumed multi-run cost totals from serialized instead of median
  • add regression coverage for both failure-path propagation and resume summary aggregation

Testing

  • pytest eval-harness/tests/test_reporter.py eval-harness/tests/test_task_runner.py eval-harness/tests/test_resume.py eval-harness/tests/test_agentbench.py -q

orban added 2 commits April 4, 2026 00:01
Nightshift-Task: cost-attribution
Nightshift-Ref: https://github.com/marcus/nightshift
Nightshift-Task: cost-attribution
Nightshift-Ref: https://github.com/marcus/nightshift
@orban
Copy link
Copy Markdown
Owner Author

orban commented Apr 15, 2026

Superseded by #31, which includes the edge-case fixes plus the resumed multi-run cost median fix. Closing to consolidate review.

@orban orban closed this Apr 15, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant