DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective.

Ongoing research training transformer language models at scale, including: BERT & GPT-2

Ongoing research training transformer language models at scale, including: BERT & GPT-2

A flexible package manager that supports multiple versions, configurations, platforms, and compilers.

Your One Get Remaining Time library

Source code repository of PnetCDF library and utilities

UnifyCR: A file system for burst buffers

Next generation of ADIOS developed in the Exascale Computing Program

Particle-in-Cell Simulations for the Exascale Era ✨

Livermore Big Artificial Neural Network Toolkit

Official MPICH Repository

HACC IO kernel from the CORAL Benchmark Codes

IOR and mdtest

SW4 (Seismic Waves, 4th order) implements substantial capabilities for 3-D seismic modeling, with a free surface condition on the top boundary, absorbing super-grid conditions on the far-field boun…

Codebase for the engineering/scaling WG

🤗 The largest hub of ready-to-use NLP datasets for ML models with fast, easy-to-use and efficient data manipulation tools

SCR and Components

CS infrastructure components for HPC applications

File utilities designed for scalability and performance.

Simplified Data Exchange for HPC Simulations

ECP-CANDLE Benchmarks

An API to provide an efficient distributed queue on a cluster. Libcircle is currently used in production to quickly traverse and perform operations on a file tree which contains several hundred-mil…

Swift/T: High Performance Parallel Scripting Language

ECP-CANDLE level documentation

Proposed modifications, additions, and-or subtractions to the PMIx definitions

Source-code for Dynamic Sparse Data Exchange library for MPI

PMIx master repository