[Fix] Prevent FSDPModule from auto-converting position_embedding to bf16 in DecoderLayer#1462
Closed
HAOCHENYE wants to merge 6 commits intogh/HAOCHENYE/13/basefrom
Closed
[Fix] Prevent FSDPModule from auto-converting position_embedding to bf16 in DecoderLayer#1462HAOCHENYE wants to merge 6 commits intogh/HAOCHENYE/13/basefrom
HAOCHENYE wants to merge 6 commits intogh/HAOCHENYE/13/basefrom