Commits

Breadcrumbs

History for

onmaster

User selector

All users

All time

Commit history

Commits on Jul 1, 2026

• Feat: zero3 deprecate elastic checkpoint (#8099)

  Show description for ac5c49f
  nathon-lee

  authored
  ac5c49f

  Copy full SHA for ac5c49f

Commits on Jun 29, 2026

• Avoid CUDA context initialization during op compatibility checks at import (#8078)

  Show description for 5aef6d8
  

  3 peopleauthored
  5aef6d8

  Copy full SHA for 5aef6d8

Commits on Jun 26, 2026

• Support AutoEP with ZeRO-3 zero.Init source modules (#8060)

  Show description for 02663d6
  

  tohtana

  and

  delock

  authored
  02663d6

  Copy full SHA for 02663d6

Commits on Jun 11, 2026

• Add AutoEP (#7938)

  Show description for 7c3fbdc
  

  tohtana

  and

  delock

  authored
  7c3fbdc

  Copy full SHA for 7c3fbdc

Commits on May 28, 2026

• Add engine.coalesce_grad_reduction() for ZeRO 1/2/3 multi-backward (#7992)

  Show description for 60b242a
  

  roycho96

  and

  tohtana

  authored
  60b242a

  Copy full SHA for 60b242a

Commits on May 21, 2026

• [Blog] Muon Optimizer Support in DeepSpeed (#7962)

  Show description for de47309
  delock

  authored
  de47309

  Copy full SHA for de47309

Commits on May 20, 2026

• Support bf16 optimizer states with CPU offload (#8010)

  Show description for 3c337b5
  

  3 peopleauthored
  3c337b5

  Copy full SHA for 3c337b5

Commits on May 18, 2026

• Auto-detect CUTLASS for EvoformerAttention (#8000)

  Show description for d5356e0
  

  MaxTretikov

  and

  tohtana

  authored
  d5356e0

  Copy full SHA for d5356e0

Commits on Apr 30, 2026

• Add Gram Newton-Schulz orthogonalization for Muon optimizer (#7953)

  Show description for 8a77f38
  

  delock

  and

  PKUWZP

  authored
  8a77f38

  Copy full SHA for 8a77f38

Commits on Mar 30, 2026

• Merging AutoSP into DeepSpeed (#7860)

  Show description for 5efb24a
  

  5 peopleauthored
  5efb24a

  Copy full SHA for 5efb24a

Commits on Mar 26, 2026

• Extending Muon Optimizer Support for ZeRO Stage 3 (#7919)

  Show description for 956ec6f
  

  PKUWZP

  and

  claude

  authored
  956ec6f

  Copy full SHA for 956ec6f

Commits on Mar 25, 2026

• Add HuggingFace tp_plan support for AutoTP (#7901)

  Show description for a240c4d
  

  3 peopleauthored
  a240c4d

  Copy full SHA for a240c4d

Commits on Mar 24, 2026

• Add Feature Universal Checkpoint for AutoTP (#7908)

  Show description for f2bb1ec
  

  3 peopleauthored
  f2bb1ec

  Copy full SHA for f2bb1ec

Commits on Mar 13, 2026

• Fix Evoformer's multi-arch dispatch root cause (#7881)

  Show description for 784cc26
  

  tohtana

  and

  sfc-gh-truwase

  authored
  784cc26

  Copy full SHA for 784cc26

Commits on Mar 4, 2026

• Add document section explaining autocast nesting (#7883)

  Show description for 4dba1e2
  

  tohtana

  and

  stas00

  authored
  4dba1e2

  Copy full SHA for 4dba1e2

Commits on Mar 2, 2026

• XPU use stock pytorch instead of Intel Extension for PyTorch (#7877)

  Show description for d8e15da
  

  3 peopleauthored
  d8e15da

  Copy full SHA for d8e15da

Commits on Feb 25, 2026

• Fix broken links and add AutoTP Training tutorial to sidebar nav (#7874)

  Show description for efc0b49
  tohtana

  authored
  efc0b49

  Copy full SHA for efc0b49

Commits on Jan 31, 2026

• Support custom partitioning patterns for AutoTP (#7806)

  Show description for 6b9cab1
  tohtana

  authored
  6b9cab1

  Copy full SHA for 6b9cab1

Commits on Jan 28, 2026

• [Bugfix] Resolve Rank index out of range during BWD when sp_size < world_size in Ulysses (#7809)

  Show description for bb250a2
  

  Flink-ddd

  and

  tohtana

  authored
  bb250a2

  Copy full SHA for bb250a2

Commits on Jan 27, 2026

• Fix typos in accelerator setup guide (#7818)

  Show description for 7b76345
  nathon-lee

  authored
  7b76345

  Copy full SHA for 7b76345

Commits on Jan 18, 2026

• Fix Evoformer compilation (#7760)

  Show description for 43125a7
  

  sdvillal

  and

  tohtana

  authored
  43125a7

  Copy full SHA for 43125a7

Commits on Jan 15, 2026

• Update CLA to refer to DCO (#7778)

  Show description for e31daa8
  

  loadams

  and

  tohtana

  authored
  e31daa8

  Copy full SHA for e31daa8

• [Docs] Fix `docs/_pages/config-json.md` format (#7779)

  Show description for 79af89b
  ooooo-create

  authored
  79af89b

  Copy full SHA for 79af89b

Commits on Jan 11, 2026

• fix: update Megatron-DeepSpeed tutorial to match current repo structure (#7761)

  Show description for 8a9369d
  

  3 peopleauthored
  8a9369d

  Copy full SHA for 8a9369d

Commits on Dec 19, 2025

• Add core api update blog (#7738)

  Show description for 20cfce0
  tohtana

  authored
  20cfce0

  Copy full SHA for 20cfce0

Commits on Dec 4, 2025

• Low-precision master params/grads/optimizer states (#7700)

  Show description for 39a682d
  

  tohtana

  and

  sfc-gh-truwase

  authored
  39a682d

  Copy full SHA for 39a682d

Commits on Nov 19, 2025

• PyTorch-compatible backward API (#7665)

  Show description for 53e91a0
  tohtana

  authored
  53e91a0

  Copy full SHA for 53e91a0

Commits on Nov 18, 2025

• Add Qwen2.5 to AutoTP model list (#7696)

  Show description for a83fd7b
  delock

  authored
  a83fd7b

  Copy full SHA for a83fd7b

Commits on Nov 4, 2025

• README refresh (#7668)

  Show description for e993fea
  

  sfc-gh-truwase

  and

  stas00

  authored
  e993fea

  Copy full SHA for e993fea

Commits on Nov 3, 2025

• Fix typo in pytorch-profiler.md documentation (#7652)

  Show description for 4691beb
  

  3 peopleauthored
  4691beb

  Copy full SHA for 4691beb

Commits on Oct 29, 2025

• ALST/UlyssesSP: more intuitive API wrt variable seqlen (#7656)

  Show description for 02da373
  stas00

  authored
  02da373

  Copy full SHA for 02da373

Commits on Oct 23, 2025

• Add DataStates-LLM: Asynchronous Checkpointing Engine Support (#7166)

  Show description for d1e62ff
  

  3 peopleauthored
  d1e62ff

  Copy full SHA for d1e62ff

Commits on Oct 7, 2025

• Clarify document of leaf module config (#7623)

  Show description for 1ae1cdd
  tohtana

  authored
  1ae1cdd

  Copy full SHA for 1ae1cdd

Commits on Oct 6, 2025

• Blog of zenflow binding study (#7614)

  Show description for 2b68bbc
  

  6 peopleauthored
  2b68bbc

  Copy full SHA for 2b68bbc

Commits on Oct 3, 2025

• Improve leaf module interface (enable via config, relax matching criteria, add document, etc.) (#7604)

  Show description for 7d9a2f2
  

  tohtana

  and

  sfc-gh-truwase

  authored
  7d9a2f2

  Copy full SHA for 7d9a2f2