Skip to content

Optimize token-counting logic in summarizing condenser #1502

@csmith49

Description

@csmith49

In #1380 @xingyaoww points out that our token-counting strategy (in the condenser utils) might be inefficient. We should investigate the true behavior to determine if we need to switch to a strategy that calculates token costs per-event before starting the token-counting arithmetic.

Metadata

Metadata

Assignees

Labels

bugSomething isn't workingpriority:lowFor bugs, affects only non-mainstream cases, or is annoying but with a clear workaround.

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions