Add LoRA support for Cosmos Predict 2.5 and fix pipeline to match official Cosmos repo#13664

Open

terarachang wants to merge 15 commits intohuggingface:mainfrom

terarachang:cosmos_predict_2.5_lora_clean

Commits on Apr 30, 2026

support lora for cosmos 2.5
Ting-Yun Chang
committed
Fix inconsistencies with cosmos official repo in VAE encoding, text encoder attention implementation, and timestep scaling
Ting-Yun Chang
committed
Support f_min and f_max in linear_scheduler warmup
Ting-Yun Chang
committed
Add requirements and dataset preprocessing scripts to run examples
Ting-Yun Chang
committed
Add LoRA training scripts
Ting-Yun Chang
committed
Add LoRA eval scripts
Ting-Yun Chang
committed
add assets for blogpost
Ting-Yun Chang
committed
Fix(scheduler): device mismatch from upstream b114620 - move rk and b to device before torch.stack
Ting-Yun Chang
committed
Always upcast to fp32
Ting-Yun Chang
committed

Commits on May 2, 2026

Directly inhrit from LoraBaseMixin
Ting-Yun Chang
committed

Commits on May 5, 2026

remove flash-attn2

Ting-Yun Chang
authored and
terarachang
committed
Use _keep_in_fp32_modules instead of autocast
Ting-Yun Chang
committed
remove the get_latent_shape_cthw method and fix style
Ting-Yun Chang
committed
simplifiy the eval script to make it more user-friendly
Ting-Yun Chang
committed
overwrite scheduling_unipc_multistep.py with main's version
Ting-Yun Chang
committed