A guide that integrates Pytorch DistributedDataParallel, Apex, warmup, learning rate scheduler, also mentions the set-up of early-stopping and random seed.

Aligning latent space of speaking style with human perception using a re-embedding strategy

This project contains scripts/modules for distributed training

Distributed training using PyTorch DDP & Suggestive resource allocation