Test fixes + moving dtypes out of the test#4439

loadams wants to merge 1 commit intomasterdeepspeedai/DeepSpeed:masterfrom

loadams/fix-cpu-inf-test-timedeepspeedai/DeepSpeed:loadams/fix-cpu-inf-test-timeCopy head branch name to clipboard