Mesh TensorFlow (mtf) is a language for distributed deep learning, capable of specifying a broad class of distributed tensor computations. Its purpose is to formalize and implement distribution strategies for your computation graph over your hardware/processors