For structured decoding, we utilize llguidance in our regular Mellea code. For intrinsics that utilize granite formatters, we utilize xgrammar. We should see if we can consolidate to llguidance.
The person who takes this task should check in with Fred to see why xgrammar was originally chosen.
For structured decoding, we utilize llguidance in our regular Mellea code. For intrinsics that utilize granite formatters, we utilize xgrammar. We should see if we can consolidate to llguidance.
The person who takes this task should check in with Fred to see why xgrammar was originally chosen.