Skip to content

Emit model usage events #2137

@amorton

Description

@amorton

Now we have #2008 add feature flags to configure emitting model usage events in headers.

We want billing events for the egress bytes, ingress bytes, and token usage.

Use feature flags to enable / disable at config time and at request time.

As part of this, also add metrics for ModelUsage

Metadata

Metadata

Assignees

Labels

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions