Repository navigation

Issues

New issue

[Tracking] Move off liger-kernel and make the memory-efficient loss the default
#7063 · qgallouedec opened on Sep 4, 2026
8
[Tracking] TRL on AWS Trainium (Neuron)
#7658 · qgallouedec opened on Oct 13, 2026
[Tracking] Promote AsyncGRPO to the stable API
#7841 · qgallouedec opened on Oct 20, 2026
2

GOLDTrainer: no pad_token fallback for plain tokenizers
huggingface/trl#8255 · opened on Nov 11, 2026
KTOTrainer: train_sampling_strategy="group_by_length" always fails (no input_ids column)
huggingface/trl#8254 · opened on Nov 11, 2026
DistillationTrainer + FSDP2: teacher stays on CPU, step 1 fails with "Expected all tensors to be on the same device"
huggingface/trl#8253 · opened on Nov 11, 2026
SFT evaluation fails when compute_loss returns a tensor requiring gradients
huggingface/trl#8246 · opened on Nov 10, 2026
[Tracking] Support more model types in compute_flops_per_token
huggingface/trl#8237 · opened on Nov 10, 2026
1
Regenerating a trl-internal-testing tiny model in place changes it for every repo that loads it
huggingface/trl#8234 · opened on Nov 10, 2026
Support Nemotron-H in AsyncGRPO
huggingface/trl#8233 · opened on Nov 10, 2026
Support Granite 4.0 hybrid models in AsyncGRPO
huggingface/trl#8232 · opened on Nov 10, 2026
Support GPT-OSS in AsyncGRPO
huggingface/trl#8231 · opened on Nov 10, 2026
SFT with assistant_only_loss trains the generation prompt's <|start|>assistant on Muse Spark Open
huggingface/trl#8223 · opened on Nov 10, 2026
1
SFT with assistant_only_loss trains the generation prompt's <|start|>assistant on Muse Glimmer
huggingface/trl#8220 · opened on Nov 10, 2026
SFT with assistant_only_loss trains the generation prompt's <|start|>assistant on gpt-oss
huggingface/trl#8218 · opened on Nov 10, 2026
SFT with assistant_only_loss trains the pre-filled thinking block on Nemotron 3
huggingface/trl#8216 · opened on Nov 10, 2026
CI fails with dev dependencies for DeepSeek training chat templates: jinja2.exceptions.UndefinedError: 'dict object' has no attribute 'content'
huggingface/trl#8214 · opened on Nov 10, 2026
2
DistillationTrainer: the Python API ignores teacher_model_name_or_path
huggingface/trl#8213 · opened on Nov 10, 2026
2
AsyncGRPO: prefix cache keeps KV from old weights across weight syncs
huggingface/trl#8212 · opened on Nov 10, 2026
2
[Tracking] Support tokenizers 1.0
huggingface/trl#8203 · opened on Nov 9, 2026
SFT with assistant_only_loss trains the pre-filled thinking block on chat templates shipped with generation tags (Qwen3.6, Qwen3.8)
huggingface/trl#8182 · opened on Nov 9, 2026
3
AsyncGRPO with top_k/top_p crashes on vLLM >= 0.32
huggingface/trl#8178 · opened on Nov 8, 2026
1
GRPOTrainer hangs in multi-process training when tool responses return images on some ranks but not others (log_multimodal gather is rank-conditional)
huggingface/trl#8177 · opened on Nov 8, 2026
1
DPOTrainer: SFT loss weighting changes with gradient accumulation for unequal-length completions
huggingface/trl#8176 · opened on Nov 8, 2026
1
Add UDPO and URM losses for noisy preferences (ICML 2026)
huggingface/trl#8175 · opened on Nov 8, 2026
1
GRPOTrainer / RLOOTrainer keep moving the weights on steps where every advantage is zero (AdamW momentum)
huggingface/trl#8173 · opened on Nov 8, 2026
2
SFTTrainer keeps ShareGPT roles human/gpt: Qwen3 renders nothing and the train dataset ends up empty
huggingface/trl#8162 · opened on Nov 6, 2026
is_conversational result depends on PYTHONHASHSEED
huggingface/trl#8149 · opened on Nov 6, 2026
1

Navigation Menu

Repository navigation

Issues

Issues

GOLDTrainer: no pad_token fallback for plain tokenizers

KTOTrainer: train_sampling_strategy="group_by_length" always fails (no input_ids column)

DistillationTrainer + FSDP2: teacher stays on CPU, step 1 fails with "Expected all tensors to be on the same device"

SFT evaluation fails when compute_loss returns a tensor requiring gradients

[Tracking] Support more model types in `compute_flops_per_token`

Regenerating a trl-internal-testing tiny model in place changes it for every repo that loads it

Support Nemotron-H in AsyncGRPO

Support Granite 4.0 hybrid models in AsyncGRPO

Support GPT-OSS in AsyncGRPO

SFT with assistant_only_loss trains the generation prompt's `<|start|>assistant` on Muse Spark Open

SFT with assistant_only_loss trains the generation prompt's `<|start|>assistant` on Muse Glimmer

SFT with assistant_only_loss trains the generation prompt's `<|start|>assistant` on gpt-oss

SFT with assistant_only_loss trains the pre-filled thinking block on Nemotron 3

CI fails with dev dependencies for DeepSeek training chat templates: jinja2.exceptions.UndefinedError: 'dict object' has no attribute 'content'

DistillationTrainer: the Python API ignores teacher_model_name_or_path

AsyncGRPO: prefix cache keeps KV from old weights across weight syncs

[Tracking] Support tokenizers 1.0

SFT with assistant_only_loss trains the pre-filled thinking block on chat templates shipped with generation tags (Qwen3.6, Qwen3.8)

AsyncGRPO with top_k/top_p crashes on vLLM >= 0.32

GRPOTrainer hangs in multi-process training when tool responses return images on some ranks but not others (log_multimodal gather is rank-conditional)

DPOTrainer: SFT loss weighting changes with gradient accumulation for unequal-length completions

Add UDPO and URM losses for noisy preferences (ICML 2026)

GRPOTrainer / RLOOTrainer keep moving the weights on steps where every advantage is zero (AdamW momentum)

SFTTrainer keeps ShareGPT roles `human`/`gpt`: Qwen3 renders nothing and the train dataset ends up empty

`is_conversational` result depends on `PYTHONHASHSEED`