Align pretrain model load and device handling#15321

ultranity wants to merge 1 commit intoNVIDIA-NeMo:mainNVIDIA-NeMo/NeMo:mainfrom

ultranity:patch-2ultranity/NeMo:patch-2Copy head branch name to clipboard