-
Notifications
You must be signed in to change notification settings - Fork 117
feat: streaming span events #1051
Copy link
Copy link
Open
Labels
area/backendsProvider-specific work: Ollama, HF, LiteLLM, OpenAI, Bedrock, vLLMProvider-specific work: Ollama, HF, LiteLLM, OpenAI, Bedrock, vLLMarea/streamingStreaming chunks, events, per-chunk validationStreaming chunks, events, per-chunk validationarea/telemetryOTel spans, metrics, tracing, semconvOTel spans, metrics, tracing, semconvenhancementNew feature or requestNew feature or request
Metadata
Metadata
Assignees
Labels
area/backendsProvider-specific work: Ollama, HF, LiteLLM, OpenAI, Bedrock, vLLMProvider-specific work: Ollama, HF, LiteLLM, OpenAI, Bedrock, vLLMarea/streamingStreaming chunks, events, per-chunk validationStreaming chunks, events, per-chunk validationarea/telemetryOTel spans, metrics, tracing, semconvOTel spans, metrics, tracing, semconvenhancementNew feature or requestNew feature or request
Type
Fields
Give feedbackNo fields configured for issues without a type.
Background
Retired sub-issue #476 proposed span events for streaming. @planetf1's open work on streaming event types (#902 / #1013, PRs #958 and #942) is the right place for this to land — the bridge between Mellea's internal streaming events and OTel span events.
Scope
Pending @planetf1's streaming-events design, add span events on backend generation spans for:
gen_ai.choiceor equivalent first-token event (carriesttfb_ms— currently metrics-only).MELLEA_TRACES_STREAM_CHUNKSper refactor: rename tracing env vars to plural and align with OTel semconv #1046's plural convention, to avoid noise).Optionally surface
MELLEA_TRACES_STREAM_SAMPLE_RATEfor chunk sampling.Phase & dependencies
Phase 2 (coverage). Depends on Phase 1 (#1045, #1046, #1047). Coordinates with #902 / PR #958 — this issue is the consumer side; @planetf1's work is the producer side. Can proceed in parallel with #1048, #1049, #1050, #1052.
Acceptance criteria
Parent epic: #444