Skip to content

Support LLM.int8() inference with torch.compile#1594

Merged
matthewdouglas merged 1 commit intomainfrom
int8-compile
Apr 17, 2025
Merged

Support LLM.int8() inference with torch.compile#1594
matthewdouglas merged 1 commit intomainfrom
int8-compile

Commits

Commits on Apr 15, 2025