Skip to content

Pull requests: huggingface/trl

New pull request New
98 Open 2,808 Closed
98 Open 2,808 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Add truncation to SFT DataCollatorForLanguageModeling
#5315 opened Mar 19, 2026 by albertvillanova Loading…
7
fix: fix a bug in vLLM weight synchronization when vllm_enable_sleep_mode=True
#5313 opened Mar 19, 2026 by muupan Loading…
1 of 5 tasks
1
4
Show conversations instead of decoded text in the completions table
#5309 opened Mar 19, 2026 by qgallouedec Loading…
6
Add support for logging extra columns in reward functions and update related tests
#5308 opened Mar 19, 2026 by qgallouedec Loading…
4
Rollout generation
#5299 opened Mar 18, 2026 by AmineDiro Loading…
49
fix: skip ref adapter when peft config uses target_parameters
#5292 opened Mar 16, 2026 by gambletan Loading…
3 tasks
1
2
docs: clarify PPO entropy metrics in PPO trainer docs
#5289 opened Mar 14, 2026 by biefan Loading…
1
Add reference to DeepSeekMath in accuracy_reward docstring
#5287 opened Mar 13, 2026 by qgallouedec Loading…
5 tasks
4
Add Cursor rules from AGENTS.md
#5280 opened Mar 12, 2026 by qgallouedec Loading…
8
Add Nemotron 3 to tests via tiny model
#5278 opened Mar 12, 2026 by sergiopaniego Loading…
5 tasks
11
Centralize AI agent templates in .ai
#5268 opened Mar 10, 2026 by qgallouedec Loading…
5
Introduce backend rollout-completions interface and decouple OpenEnv helper from vLLM internals
#5256 opened Mar 10, 2026 by rycerzes Loading…
1
2
async streaming grpo w prefetch
#5250 opened Mar 9, 2026 by winglian Loading…
5 tasks
6
batch params together in weight sync and async update the weights
#5249 opened Mar 9, 2026 by winglian Loading…
5 tasks
5
Introduce minimal generation backend interface for GRPO and RLOO trainers
#5244 opened Mar 8, 2026 by rycerzes Loading…
1
6
feat: log raw importance ratios and fraction of truncation/masking in vLLM importance sampling correction
#5243 opened Mar 8, 2026 by muupan Loading…
1 of 5 tasks
1
5
Update openenv examples to use environment_factory
#5235 opened Mar 6, 2026 by sergiopaniego Loading…
3 of 8 tasks
15
vLLM Server Sync via LoRA Adapter Reload (avoid merge + full weight sync) for GRPO
#5188 opened Feb 26, 2026 by lfranceschetti Loading…
2
1
Simplify NeMo Gym user experience
#5156 opened Feb 24, 2026 by cmunley1 Loading…
3
DPO padding-free
#5141 opened Feb 21, 2026 by qgallouedec • Draft
5 tasks
6
MGPO feature addition
#5126 opened Feb 19, 2026 by damoonsh Loading…
2 of 5 tasks
wip(neuron): add neuron integration for SFT
#5125 opened Feb 18, 2026 by michaelbenayoun • Draft
feat(experimental): Divergence Proximal Policy Optimization
#5117 opened Feb 17, 2026 by LeonEricsson Loading…
5 tasks
42
Add prefix-preserving training chat template for GPT-OSS
#5109 opened Feb 17, 2026 by qgallouedec • Draft
10
Add support for DGPO (ICLR 2026) to GRPO
#5102 opened Feb 15, 2026 by YanqiDai Loading…
5 tasks done
33
ProTip! Updated in the last three days: updated:>2026-03-16.