-
Notifications
You must be signed in to change notification settings - Fork 4.9k
Pull requests: deepspeedai/DeepSpeed
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
Fix ZeRO-3 all_reduce param fetch stride for padded parameters
#8158
opened Jul 19, 2026 by
ebarkhordar
Loading…
Clamp capacity to num_tokens in MoE gating drop branches (complete #5353)
#8155
opened Jul 18, 2026 by
ebarkhordar
Loading…
Fix repeated gradient scaling across pipeline stages
#8154
opened Jul 18, 2026 by
Functionhx
Loading…
Validate warmup_type in WarmupCosineLR like WarmupLR
#8151
opened Jul 17, 2026 by
sohumt123
Loading…
Z3: Support for activation ckpt with frozen params
#8148
opened Jul 16, 2026 by
sfc-gh-truwase
Collaborator
Loading…
[AutoTP] Enalbe HF
colwise_gather_output to support lm_head replace
#8146
opened Jul 15, 2026 by
jinyouzhi
Contributor
Loading…
Add governance process page to deepspeed.ai
#8138
opened Jul 13, 2026 by
PKUWZP
Collaborator
Loading…
3 tasks
Feature/zero multi loss separate backward
#8135
opened Jul 12, 2026 by
nathon-lee
Contributor
Loading…
fix: add zero-guards for divisor/scale edge cases (#7838)
#8133
opened Jul 12, 2026 by
liuyun7345
Loading…
7 tasks done
ZeRO-3: don't partition frozen params during an activation-checkpoint recompute
#8130
opened Jul 10, 2026 by
qgallouedec
Contributor
Loading…
Add Ulysses SP support for FLA gated-delta context parallelism
#8114
opened Jul 2, 2026 by
xylian86
Collaborator
Loading…
ZeRO-3: stream partitioning of oversized parameters in zero.Init
#8103
opened Jun 30, 2026 by
Achyuthan-S
Contributor
Loading…
Warn when zero.Init silently falls back to a single rank (#8084)
#8089
opened Jun 24, 2026 by
akshansh47
Loading…
feat: add Trackio as a new experiment monitoring backend
#8065
opened Jun 15, 2026 by
chanduripranav
Loading…
zero3: defer param release during retain_graph backward #7352
#8045
opened Jun 3, 2026 by
nathon-lee
Contributor
•
Draft
Refactor/torch autocast encapsulate global state
#7946
opened Apr 2, 2026 by
nathon-lee
Contributor
Loading…
Fix ZeRO-3 optimizer initialization validation (#7844)
#7929
opened Mar 28, 2026 by
amadhan882
Loading…
Previous Next
ProTip!
Type g p on any issue or pull request to go back to the pull request listing page.