☆47Dec 13, 2024Updated last year
Alternatives and similar repositories for msccl-executor-nccl
Users that are interested in msccl-executor-nccl are comparing it to the libraries listed below
Sorting:
- NCCL Profiling Kit☆152Jul 1, 2024Updated last year
- MSCCL++: A GPU-driven communication stack for scalable AI applications☆490Updated this week
- GPU-accelerated LLM Training Simulator☆18Jun 26, 2025Updated 8 months ago
- RDMA and SHARP plugins for nccl library☆224Updated this week
- ☆19Sep 10, 2025Updated 6 months ago
- [DEPRECATED] Moved to ROCm/rocm-systems repo☆413Updated this week
- Microsoft Collective Communication Library☆66Nov 23, 2024Updated last year
- An external memory allocator example for PyTorch.☆16Aug 10, 2025Updated 7 months ago
- Microsoft Collective Communication Library☆387Sep 20, 2023Updated 2 years ago
- NCCL Fast Socket is a transport layer plugin to improve NCCL collective communication performance on Google Cloud.☆122Nov 15, 2023Updated 2 years ago
- Dynamic Memory Management for Serving LLMs without PagedAttention☆466May 30, 2025Updated 9 months ago
- Lumina is a user-friendly tool to test the correctness and performance of hardware network stacks.☆29Jan 8, 2024Updated 2 years ago
- Depict GPU memory footprint during DNN training of PyTorch☆11Nov 17, 2022Updated 3 years ago
- [DEPRECATED] Moved to ROCm/rocm-systems repo☆88Mar 5, 2026Updated 2 weeks ago
- Manages vllm-nccl dependency☆17Jun 3, 2024Updated last year
- TiledLower is a Dataflow Analysis and Codegen Framework written in Rust.☆13Nov 23, 2024Updated last year
- TACCL: Guiding Collective Algorithm Synthesis using Communication Sketches☆80Jul 25, 2023Updated 2 years ago
- PSTensor provides a way to hack the memory management of tensors in TensorFlow and PyTorch by defining your own C++ Tensor Class.☆10Feb 10, 2022Updated 4 years ago
- Venus Collective Communication Library, supported by SII and Infrawaves.☆140Mar 4, 2026Updated 2 weeks ago
- DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling☆21Updated this week
- High Performance Grouped GEMM in PyTorch☆30May 10, 2022Updated 3 years ago
- This is an official GitHub repository for the paper, "Towards timeout-less transport in commodity datacenter networks.".☆16Oct 12, 2021Updated 4 years ago
- Documentation for TCP Lab☆12May 20, 2025Updated 10 months ago
- Pipeline-Parallel Lecture: Simplest Dualpipe Implementation.☆31Sep 17, 2025Updated 6 months ago
- GPTQ inference TVM kernel☆40Apr 25, 2024Updated last year
- Chimera: bidirectional pipeline parallelism for efficiently training large-scale models.☆70Mar 20, 2025Updated last year
- CUDA checkpoint and restore utility☆429Sep 15, 2025Updated 6 months ago
- 方便扩展的Cuda算子理解和优化框架，仅用在学习使用☆18Jun 13, 2024Updated last year
- ☆47Jul 16, 2025Updated 8 months ago
- An auxiliary project analysis of the characteristics of KV in DiT Attention.☆33Nov 29, 2024Updated last year
- ☆13Mar 27, 2023Updated 2 years ago
- An Attention Superoptimizer☆22Jan 20, 2025Updated last year
- WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.☆17Aug 4, 2022Updated 3 years ago
- Microsoft Automatic Mixed Precision Library☆635Dec 1, 2025Updated 3 months ago
- Benchmark tests supporting the TiledCUDA library.☆18Nov 19, 2024Updated last year
- Paper list of federated learning: About system design☆13Apr 13, 2022Updated 3 years ago
- Multiple GEMM operators are constructed with cutlass to support LLM inference.☆19Aug 3, 2025Updated 7 months ago
- ☆54Feb 1, 2026Updated last month
- Matrix multiplication on GPUs for matrices stored on a CPU. Similar to cublasXt, but ported to both NVIDIA and AMD GPUs.☆31Apr 2, 2025Updated 11 months ago