Skip to content

[Fix] Muon optimizer per-expert orthogonalization for MoE models#1582

Merged
HAOCHENYE merged 6 commits intoInternLM:mainfrom
CyCle1024:muon_per_expert_optimizer
Mar 29, 2026
Merged

[Fix] Muon optimizer per-expert orthogonalization for MoE models#1582
HAOCHENYE merged 6 commits intoInternLM:mainfrom
CyCle1024:muon_per_expert_optimizer

Commits

Commits on Mar 28, 2026