Improve CI build performance, especially on macOS#5796

danlapid merged 1 commit intomaincloudflare/workerd:mainfrom

dlapid/ci-improvementscloudflare/workerd:dlapid/ci-improvementsCopy head branch name to clipboard