paperg / NCCL_GPLinks
Separate from hardware and used to learn some NCCL mechanisms
☆25Updated last year
Alternatives and similar repositories for NCCL_GP
Users that are interested in NCCL_GP are comparing it to the libraries listed below
Sorting:
- ☆223Updated 2 years ago
- ☆231Updated last month
- example code for using DC QP for providing RDMA READ and WRITE operations to remote GPU memory☆152Updated last year
- RDMA and SHARP plugins for nccl library☆223Updated 3 weeks ago
- Injecting Adrenaline into LLM Serving: Boosting Resource Utilization and Throughput via Attention Disaggregation☆40Updated 3 months ago
- ☆31Updated last year
- NCCL Profiling Kit☆152Updated last year
- ☆42Updated last year
- DeepSeek-V3/R1 inference performance simulator☆176Updated 10 months ago
- TACCL: Guiding Collective Algorithm Synthesis using Communication Sketches☆80Updated 2 years ago
- ☆77Updated last month
- Artifacts for our NSDI'23 paper TGS☆96Updated last year
- RDMA exmaple☆235Updated 3 years ago
- Repository for MLCommons Chakra schema and tools☆153Updated 3 months ago
- ☆95Updated 10 months ago
- A lightweight design for computation-communication overlap.☆219Updated 3 weeks ago
- A prefill & decode disaggregated LLM serving framework with shared GPU memory and fine-grained compute isolation.☆123Updated last month
- Microsoft Collective Communication Library☆381Updated 2 years ago
- Here are my personal paper reading notes (including machine learning systems, AI infrastructure, and other interesting stuffs).☆155Updated 2 weeks ago
- ☆46Updated 2 months ago
- Synthesizer for optimal collective communication algorithms☆124Updated last year
- AI Accelerator Benchmark focuses on evaluating AI Accelerators from a practical production perspective, including the ease of use and ver…☆298Updated 3 weeks ago
- ☆47Updated last year
- NCCL Fast Socket is a transport layer plugin to improve NCCL collective communication performance on Google Cloud.☆122Updated 2 years ago
- ☆39Updated 4 years ago
- Modular RDMA Interface☆76Updated this week
- ☆22Updated last year
- Paella: Low-latency Model Serving with Virtualized GPU Scheduling☆68Updated last year
- An interference-aware scheduler for fine-grained GPU sharing☆159Updated 2 months ago
- High performance Transformer implementation in C++.☆151Updated last year