DeepSpeed library for distributed training and inference acceleration
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective. It enables world-class training speed, memory efficiency, scalability, and accessibility for large model training and inference.