nccl
NVIDIA Collective Communications Library. Implements multi-GPU and multi-node collective communication primitives for NVIDIA GPUs.
NVIDIA Collective Communications Library. Implements multi-GPU and multi-node collective communication primitives for NVIDIA GPUs.
To install this package, run one of the following:
NCCL (pronounced "Nickel") is a stand-alone library of standard collective communication routines for GPUs, implementing all-reduce, all-gather, reduce, broadcast, and reduce-scatter.
Summary
NVIDIA Collective Communications Library. Implements multi-GPU and multi-node collective communication primitives for NVIDIA GPUs.
Last Updated
Feb 18, 2021 at 06:54
Supported Platforms
GitHub Repository
https://github.com/NVIDIA/nccl.git