CI: skip rebuilding CPU lib when building/installing wheels#1803

matthewdouglas merged 2 commits intomainbitsandbytes-foundation/bitsandbytes:mainfrom

ci-skip-rebuildbitsandbytes-foundation/bitsandbytes:ci-skip-rebuildCopy head branch name to clipboard