DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
COMMITS
/ docs/code-docs/source/activation-checkpointing.rst May 19, 2020
J
ZeRO-2 (#217)
Jeff Rasley committed