Skip to content

Add option to replicate attn weights on FSDP or EP#3480

Open
gobbleturk wants to merge 7 commits intomainfrom
mattdavidow-embed-module-sharding
Open

Add option to replicate attn weights on FSDP or EP#3480
gobbleturk wants to merge 7 commits intomainfrom
mattdavidow-embed-module-sharding

Commits

Commits on Mar 21, 2026

Commits on Mar 23, 2026