Bedrock Token Counting

[TimPansino]

Overview

• Add token counting to Bedrock via botocore and aiobotocore for all LLM invocations.

[github-actions]

✅MegaLinter analysis: Success

Descriptor	Linter	Files	Fixed	Errors	Warnings	Elapsed time
✅ ACTION	actionlint	8		0	0	1.08s
✅ MARKDOWN	markdownlint	7	0	0	0	1.56s
✅ PYTHON	ruff	1038	0	0	0	1.16s
✅ PYTHON	ruff-format	1038	0	0	0	0.43s
✅ YAML	prettier	20	0	0	0	1.76s
✅ YAML	v8r	20		0	0	7.51s
✅ YAML	yamllint	20		0	0	0.77s

Notices

📣 MegaLinter 9.5.0 is out! Discover the new features and security recommendations in the release announcement. (Skip this info by defining SECURITY_SUGGESTIONS: false)

See detailed reports in MegaLinter artifacts

Show us your support by starring ⭐ the repository

[codecov-commenter]

Codecov Report

❌ Patch coverage is 95.72650% with 5 lines in your changes missing coverage. Please review.
✅ Project coverage is 82.11%. Comparing base (4e896ef) to head (298e5ed).

Files with missing lines	Patch %	Lines
newrelic/hooks/external_botocore.py	95.72%	0 Missing and 5 partials ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #1752      +/-   ##
==========================================
+ Coverage   82.01%   82.11%   +0.10%     
==========================================
  Files         215      215              
  Lines       26324    26409      +85     
  Branches     4153     4163      +10     
==========================================
+ Hits        21589    21686      +97     
+ Misses       3316     3304      -12     
  Partials     1419     1419              

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.