NVIDIA / nccl
Optimized primitives for collective multi-GPU communication
☆3,227Updated last month
Related projects ⓘ
Alternatives and complementary repositories for nccl
- NCCL Tests☆884Updated last week
- Collective communications library with various primitives for multi-machine training.☆1,218Updated this week
- A fast GPU memory copy library based on NVIDIA GPUDirect RDMA technology☆886Updated last week
- [ARCHIVED] Cooperative primitives for CUDA C++. See https://github.com/NVIDIA/cccl☆1,679Updated last year
- FB (Facebook) + GEMM (General Matrix-Matrix Multiplication) - https://code.fb.com/ml-applications/fbgemm/☆1,202Updated this week
- A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper and Ada GPUs…☆1,936Updated this week
- CUDA Templates for Linear Algebra Subroutines☆5,629Updated this week
- Reference implementations of MLPerf™ training benchmarks☆1,614Updated 3 weeks ago
- common in-memory tensor structure☆905Updated last month
- Open MPI main development repository☆2,163Updated this week
- oneAPI Deep Neural Network Library (oneDNN)☆3,619Updated this week
- Open deep learning compiler stack for cpu, gpu and specialized accelerators☆11,761Updated this week
- Low-precision matrix multiplication☆1,780Updated 9 months ago
- Transformer related optimization, including BERT, GPT☆5,871Updated 7 months ago
- Acceleration package for neural networks on multi-core CPUs☆1,674Updated 4 months ago
- FlexFlow Serve: Low-Latency, High-Performance LLM Serving☆1,698Updated this week
- Source code examples from the Parallel Forall Blog☆1,237Updated 3 months ago
- The Triton Inference Server provides an optimized cloud and edge inferencing solution.☆8,296Updated this week
- The Torch-MLIR project aims to provide first class support from the PyTorch ecosystem to the MLIR ecosystem.☆1,348Updated this week
- A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep lear…☆5,139Updated this week
- Benchmarking Deep Learning operations on different hardware☆1,071Updated 3 years ago
- PyTorch extensions for high performance and large scale training.☆3,187Updated 2 months ago
- ☆1,655Updated 6 years ago
- TorchBench is a collection of open source benchmarks used to evaluate PyTorch performance.☆873Updated this week
- ☆567Updated 6 years ago
- PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT☆2,585Updated this week
- Unified Communication X (mailing list - https://elist.ornl.gov/mailman/listinfo/ucx-group)☆1,153Updated this week
- Reference implementations of MLPerf™ inference benchmarks☆1,226Updated this week
- A machine learning compiler for GPUs, CPUs, and ML accelerators☆2,690Updated this week
- A flexible and efficient deep neural network (DNN) compiler that generates high-performance executable from a DNN model description.☆959Updated last month