Pinned

1. microsoft/DeepSpeed Public

   DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

   Python 24.1k 2.9k

2. microsoft/DeepSpeedExamples Public

   Example models using DeepSpeed

   Python 3.8k 624

3. microsoft/Megatron-DeepSpeed Public

   Forked from NVIDIA/Megatron-LM

   Ongoing research training transformer language models at scale, including: BERT & GPT-2

   Python 576 118