Skip to content

consolidate between llguidance and xgrammar #1004

@jakelorocco

Description

@jakelorocco

For structured decoding, we utilize llguidance in our regular Mellea code. For intrinsics that utilize granite formatters, we utilize xgrammar. We should see if we can consolidate to llguidance.

The person who takes this task should check in with Fred to see why xgrammar was originally chosen.

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions