DeepSpeed: Accelerating large-scale model inference and training via system optimizations and compression - Microsoft Research

Last month, the DeepSpeed Team announced ZeRO-Infinity, a step forward in training models with tens of trillions of parameters. In addition to creating optimizations for scale, our team strives to introduce features that also improve speed, cost, and usability. As the DeepSpeed optimization library evolves, we are listening to the growing DeepSpeed community to learn […]

DeepSpeed: Microsoft Research blog - Microsoft Research

N] Improvement on model's inference from DeepSpeed team. [D] How is Jax compared? : r/MachineLearning

Pre-trained models: Past, present and future - ScienceDirect

DeepSpeed: Advancing MoE inference and training to power next-generation AI scale - Microsoft Research

LLM（十二）：DeepSpeed Inference 在LLM 推理上的优化探究- 知乎

DeepSpeed: Accelerating large-scale model inference and training via system optimizations and compression - Microsoft Research

DeepSpeed powers 8x larger MoE model training with high performance - Microsoft Research

media.nngroup.com/media/editor/2020/07/31/ux-bench

Deploying Large NLP Models: Infrastructure Cost Optimization

Samyam Rajbhandari - CatalyzeX

DeepSpeed: Accelerating large-scale model inference and training via system optimizations and compression - Microsoft Research