Commits

Branch selector

 master

User selector

All users

All time

Commit history

Commits on Oct 22, 2021

• add moe+zero ckpt unit test. (#1429)

  Show description for 0b77d1d
  awan-10

  authored
  0b77d1d

  Copy full SHA for 0b77d1d

• fix pp (#1474)

  conglongli

  authored
  29bee73

  Copy full SHA for 29bee73

Commits on Oct 21, 2021

• fix pipeline engine (#1473)

  Show description for 17a479d
  conglongli

  authored
  17a479d

  Copy full SHA for 17a479d

• Ensure single zero3 context (#1462)

  Show description for 58a8e13
  

  tjruwase

  and

  jeffra

  authored
  58a8e13

  Copy full SHA for 58a8e13

• Switch to use or not einsum op. Needed for ORT (#1456)

  Show description for 20bf1cc
  

  3 peopleauthored
  20bf1cc

  Copy full SHA for 20bf1cc

Commits on Oct 20, 2021

• fix typos and add improvements (#1463)

  stas00

  authored
  dd22428

  Copy full SHA for dd22428

Commits on Oct 18, 2021

• document about engine.load_checkpoint() (#1457)

  Show description for b4e5826
  

  skpig

  and

  skpig

  authored
  b4e5826

  Copy full SHA for b4e5826

Commits on Oct 13, 2021

• Add basic MoE timing breakdown (#1428)

  awan-10

  authored
  1fc74cb

  Copy full SHA for 1fc74cb

• Fix docstrings for lr_schedules.py (#1455)

  junxu

  authored
  c64a03d

  Copy full SHA for c64a03d

Commits on Oct 11, 2021

• fix sparse_attention imports (#1446)

  Show description for 80e263c
  

  olegklimov

  and

  jeffra

  authored
  80e263c

  Copy full SHA for 80e263c

• webpage link edit (#1450)

  

  Shaden Smith

  authored
  f88b0e5

  Copy full SHA for f88b0e5

• doc update (#1448)

  jeffra

  authored
  4e73623

  Copy full SHA for 4e73623

• [docs] 530b update (#1447)

  Show description for 57a9954
  jeffra

  authored
  57a9954

  Copy full SHA for 57a9954

Commits on Oct 10, 2021

• fix cl for pp support (#1443)

  conglongli

  authored
  cd7967d

  Copy full SHA for cd7967d

Commits on Oct 8, 2021

• CL for big science (#1440)

  Show description for fbea7b4
  conglongli

  authored
  fbea7b4

  Copy full SHA for fbea7b4

Commits on Oct 7, 2021

• Big science fix passing multiple tensors (#1400)

  Show description for 9c67278
  

  6 peopleauthored
  9c67278

  Copy full SHA for 9c67278

Commits on Oct 6, 2021

• Fix typo (ValueError) (#1434)

  Show description for d8e9ef6
  

  rpengms

  and

  jeffra

  authored
  d8e9ef6

  Copy full SHA for d8e9ef6

• bump DSE commit

  jeffra

  committed
  5986dbc

  Copy full SHA for 5986dbc

• bump to 0.5.5

  jeffra

  committed
  5fbff46

  Copy full SHA for 5fbff46

• Fix the workspace allocation for the transformer kernel (#1397)

  Show description for bc7778e
  RezaYazdaniAminabadi

  authored
  bc7778e

  Copy full SHA for bc7778e

Commits on Oct 5, 2021

• Make the replace module more configurable (#1366)

  Show description for c6d1418
  

  kamalkraj

  and

  RezaYazdaniAminabadi

  authored
  c6d1418

  Copy full SHA for c6d1418

Commits on Oct 4, 2021

• [CI] HF tests `image-classification` requirements (#1425)

  Show description for 86457c2
  stas00

  authored
  86457c2

  Copy full SHA for 86457c2

• Revise param_shapes to be a list of ordered dict (#1424)

  Show description for dd0c8fa
  

  4 peopleauthored
  dd0c8fa

  Copy full SHA for dd0c8fa

Commits on Oct 3, 2021

• rm max_seq_length arg:DeepSpeedTransformerConfig (#1362)

  Show description for 466b0e6
  

  kamalkraj

  and

  tjruwase

  authored
  466b0e6

  Copy full SHA for 466b0e6

• [zero_to_fp32] fix to handle world_size (#1422)

  Show description for dd6bf4d
  

  stas00

  and

  tjruwase

  authored
  dd6bf4d

  Copy full SHA for dd6bf4d

Commits on Oct 2, 2021

• Fix non-fp tensor bugs of contiguous activation checkpointing (#1376)

  Show description for d1e72f2
  

  hyunwoongko

  and

  tjruwase

  authored
  d1e72f2

  Copy full SHA for d1e72f2

• Fix many typos (#1423)

  Show description for be789b1
  

  aphedges

  and

  tjruwase

  authored
  be789b1

  Copy full SHA for be789b1

Commits on Oct 1, 2021

• Add flexibility of pipeline parallel module and engine (#1399)

  Show description for 30965ea
  

  hyunwoongko

  and

  tjruwase

  authored
  30965ea

  Copy full SHA for 30965ea

• Add assert to ensure we don't skip unsupported grad dtypes (#1418)

  jeffra

  authored
  0457bb1

  Copy full SHA for 0457bb1

• Improve inference documentation (#1421)

  Show description for aa8d97e
  aphedges

  authored
  aa8d97e

  Copy full SHA for aa8d97e

Commits on Sep 30, 2021

• Save the model parallel group at inference engine statically (#1411)

  Show description for 9f17087
  

  RezaYazdaniAminabadi

  and

  jeffra

  authored
  9f17087

  Copy full SHA for 9f17087

• Fix typo in assert message (#1420)

  manuelciosici

  authored
  5612462

  Copy full SHA for 5612462

• [CI] make build names consistent

  jeffra

  authored
  a4ffc83

  Copy full SHA for a4ffc83

Commits on Sep 29, 2021

• [ci] hf dependencies (#1417)

  Show description for 8c5ffcd
  

  stas00

  and

  jeffra

  authored
  8c5ffcd

  Copy full SHA for 8c5ffcd

• Big science related changes (#1407)

  Show description for e2fdd25
  

  7 peopleauthored
  e2fdd25

  Copy full SHA for e2fdd25