paperg / NCCL_GPLinks
Separate from hardware and used to learn some NCCL mechanisms
☆25Updated last year
Alternatives and similar repositories for NCCL_GP
Users that are interested in NCCL_GP are comparing it to the libraries listed below
Sorting:
- ☆231Updated last month
- ☆223Updated 2 years ago
- example code for using DC QP for providing RDMA READ and WRITE operations to remote GPU memory☆152Updated last year
- ☆31Updated last year
- RDMA and SHARP plugins for nccl library☆223Updated last month
- DeepSeek-V3/R1 inference performance simulator☆176Updated 10 months ago
- NCCL Profiling Kit☆152Updated last year
- Hooked CUDA-related dynamic libraries by using automated code generation tools.☆172Updated 2 years ago
- ☆95Updated 10 months ago
- ☆42Updated last year
- Injecting Adrenaline into LLM Serving: Boosting Resource Utilization and Throughput via Attention Disaggregation☆40Updated 3 months ago
- DeepXTrace is a lightweight tool for precisely diagnosing slow ranks in DeepEP-based environments.☆92Updated 3 weeks ago
- Microsoft Collective Communication Library☆381Updated 2 years ago
- A lightweight design for computation-communication overlap.☆219Updated 3 weeks ago
- ☆77Updated last month
- ☆22Updated last year
- RDMA exmaple☆235Updated 3 years ago
- Offline optimization of your disaggregated Dynamo graph☆184Updated this week
- Synthesizer for optimal collective communication algorithms☆124Updated last year
- TACCL: Guiding Collective Algorithm Synthesis using Communication Sketches☆80Updated 2 years ago
- Aims to implement dual-port and multi-qp solutions in deepEP ibrc transport☆73Updated 9 months ago
- A prefill & decode disaggregated LLM serving framework with shared GPU memory and fine-grained compute isolation.☆123Updated last month
- This is an RDMA program written in Python, based on the Pyverbs provided by the rdma-core(https://github.com/linux-rdma/rdma-core) reposi…☆34Updated 4 years ago
- AI Accelerator Benchmark focuses on evaluating AI Accelerators from a practical production perspective, including the ease of use and ver…☆298Updated this week
- Paella: Low-latency Model Serving with Virtualized GPU Scheduling☆68Updated last year
- Repository for MLCommons Chakra schema and tools☆153Updated 3 months ago
- ☆39Updated 4 years ago
- NCCL Fast Socket is a transport layer plugin to improve NCCL collective communication performance on Google Cloud.☆122Updated 2 years ago
- An interference-aware scheduler for fine-grained GPU sharing☆159Updated 2 months ago
- Artifact from "Hardware Compute Partitioning on NVIDIA GPUs". THIS IS A FORK OF BAKITAS REPO. I AM NOT ONE OF THE AUTHORS OF THE PAPER.☆55Updated 2 months ago