ci: Avoid duplicate builds due to GitHub size limits #22045

Job	Run time
manifest-check	3m 15s
LP64-WIP	3m 56s
build-windows (mtl lnl)	12m 19s
build-windows (ptl)	10m 33s
build-linux (mnfst, imx8 imx8x imx8m imx8ulp)	7m 14s
build-windows (imx8 imx8x imx8m imx8ulp)	14m 55s
build-windows (tgl tgl-h)	10m 21s
build-linux (mnfst, ptl)	5m 52s
build-windows (-d, lnl)	10m 16s
build-linux (mnfst, tgl tgl-h)	6m 35s
build-linux (mnfst, mtl lnl)	6m 7s
build-linux (zmain, mtl lnl)	3m 59s
build-linux (zmain, imx8 imx8x imx8m imx8ulp)	4m 22s
build-linux (zmain, ptl)	4m 2s
build-linux (zmain, tgl tgl-h)	3m 37s
build-linux (-d, mnfst, lnl)	4m 52s
build-linux (mnfst, wcl imx95)	7m 57s
compare-linux-win	29s
	2h 0m 41s

Provide feedback