Skip to content

Emit model usage events #2137

@amorton

Description

@amorton

Now we have #2008 add feature flags to configure emitting model usage events in headers.

We want billing events for the egress bytes, ingress bytes, and token usage.

Use feature flags to enable / disable at config time and at request time.

As part of this, also add metrics for ModelUsage

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions