Skip to content

fix LigerORPOTrainer bug in none fsdp setup#1230

Draft
Ola-Vish wants to merge 1 commit into
linkedin:mainfrom
Ola-Vish:bugfix/orpo_trainer
Draft

fix LigerORPOTrainer bug in none fsdp setup#1230
Ola-Vish wants to merge 1 commit into
linkedin:mainfrom
Ola-Vish:bugfix/orpo_trainer

Conversation

@Ola-Vish
Copy link
Copy Markdown

@Ola-Vish Ola-Vish commented May 19, 2026

This is my suggested solution to the bug I reported in #1229.
With my change, the code that used to fail now works.

  • Hardware Type: NVIDIA A100-SXM4-40GB
  • [] run make test to ensure correctness
  • run make checkstyle to ensure code style
  • [] run make test-convergence to ensure convergence
image image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant