Skip to content

Commit e6bf149

Browse files
authored
Revert "Add grammar fields to GenerationConfig for constrained decoding" (pytorch#19620)
This reverts commit 7355d7b. ### Summary Temporarily reverting to restore test health for QNN jobs.
1 parent 748b15b commit e6bf149

1 file changed

Lines changed: 0 additions & 8 deletions

File tree

extension/llm/runner/irunner.h

Lines changed: 0 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -33,14 +33,6 @@ struct GenerationConfig {
3333
// Whether to echo the input prompt in the output
3434
bool echo = true;
3535

36-
// Grammar definition for constrained decoding (e.g. a JSON schema, regex,
37-
// Lark CFG, or GBNF grammar). Empty string means no constraint.
38-
std::string grammar;
39-
40-
// Grammar format: "json_schema", "regex", "lark", or "gbnf".
41-
// Only used when grammar is non-empty.
42-
std::string grammar_type;
43-
4436
// Whether to ignore EOS token and continue generating until max_new_tokens
4537
bool ignore_eos = false;
4638

0 commit comments

Comments
 (0)