[Accelerate model loading] Fix meta device and super low memory usage#1016

patrickvonplaten merged 2 commits intomainhuggingface/diffusers:mainfrom

fix_meta_device_naming_testshuggingface/diffusers:fix_meta_device_naming_testsCopy head branch name to clipboard