Skip to content

Conversation

@sakogan
Copy link

@sakogan sakogan commented Aug 30, 2023

Allow specifying the number of quantization groups in the inference test script using a quantize_groups argument.

This PR is complimentary to PR #3519 on the main repo, and should be merged with (or after) merging PR #3519.

Tagging @RezaYazdaniAminabadi as a reviewer on PR #3519.

@sakogan
Copy link
Author

sakogan commented Aug 30, 2023

need to rewrite according to recent code changes in this repo, will reopen shortly

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant