NVIDIA NVSHMEM is an NVIDIA based "shared memory" library that provides an easy-to-use CPU-side interface to allocate pinned memory that is symmetrically distributed across a cluster of NVIDIA GPUs.
conda install nvidia::libnvshmem-staticconda install nvidia/label/nvshmem-3.3.20::libnvshmem-staticconda install nvidia/label/nvshmem-3.3.24::libnvshmem-staticconda install nvidia/label/nvshmem-3.5.19::libnvshmem-static
NVIDIA NVSHMEM is an NVIDIA based "shared memory" library that provides an easy-to-use CPU-side interface to allocate pinned memory that is symmetrically distributed across a cluster of NVIDIA GPUs. NVSHMEM can significantly reduce communication and coordination overheads by allowing programmers to perform these operations from within CUDA kernels and on CUDA streams.