Skip to content

AVX512 wheels should compile with AVX512_VBMI,AVX512_VNNI, openblas. #25

@sorasoras

Description

@sorasoras

I haven't not notice much of improvement for AVX512 wheel compare to AVX2, so it's kind of pointless.
In theory, VNNI should have improve performance quite a bit for inference.
https://community.intel.com/t5/Blogs/Tech-Innovation/Artificial-Intelligence-AI/Deep-Learning-Performance-Boost-by-Intel-VNNI/post/1335670
Kind of no brainer to use AVX512_VNNI.
Thanks.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions