[tests] fix lora checkpoint serialization issues#13676

sayakpaul wants to merge 6 commits intomainhuggingface/diffusers:mainfrom

save-load-text-lorahuggingface/diffusers:save-load-text-loraCopy head branch name to clipboard