gossip: Efficient Communication Primitives for Multi-GPU Systems
☆62Jul 1, 2022Updated 3 years ago
Alternatives and similar repositories for gossip
Users that are interested in gossip are comparing it to the libraries listed below
Sorting:
- The Power of LaTeX, the Style of Markdown.☆12Sep 5, 2024Updated last year
- ddl-benchmarks: Benchmarks for Distributed Deep Learning☆36May 29, 2020Updated 5 years ago
- Official resporitory for "IPDPS' 24 QSync: Quantization-Minimized Synchronous Distributed Training Across Hybrid Devices".☆20Feb 23, 2024Updated 2 years ago
- High performance NCCL plugin for Bagua.☆15Sep 15, 2021Updated 4 years ago
- Release doc/tutorial/wheels for poseidon-tf☆10Jan 18, 2018Updated 8 years ago
- RDMA and SHARP plugins for nccl library☆224Jan 12, 2026Updated last month
- [ICDCS 2023] DeAR: Accelerating Distributed Deep Learning with Fine-Grained All-Reduce Pipelining☆12Dec 4, 2023Updated 2 years ago
- PipeSwitch: Fast Pipelined Context Switching for Deep Learning Applications☆127May 9, 2022Updated 3 years ago
- Synthesizer for optimal collective communication algorithms☆124Apr 8, 2024Updated last year
- ☆26May 19, 2021Updated 4 years ago
- ☆44Sep 6, 2021Updated 4 years ago
- ☆145Jan 30, 2025Updated last year
- Core communication lib for Bagua.☆48Sep 15, 2021Updated 4 years ago
- Official Repo for "SplitQuant / LLM-PQ: Resource-Efficient LLM Offline Serving on Heterogeneous GPUs via Phase-Aware Model Partition and …☆36Aug 29, 2025Updated 6 months ago
- PyTorch compilation tutorial covering TorchScript, torch.fx, and Slapo☆17Mar 13, 2023Updated 2 years ago
- Fast and Adaptive Distributed Machine Learning for TensorFlow, PyTorch and MindSpore.☆295Feb 23, 2024Updated 2 years ago
- Microsoft Collective Communication Library☆385Sep 20, 2023Updated 2 years ago
- A tensor-aware point-to-point communication primitive for machine learning☆283Dec 17, 2025Updated 2 months ago
- Fine-grained GPU sharing primitives☆148Jul 28, 2025Updated 7 months ago
- GRACE - GRAdient ComprEssion for distributed deep learning☆139Jul 23, 2024Updated last year
- GPTQ inference TVM kernel☆40Apr 25, 2024Updated last year
- SJTU HPC 开源项目：Spackenv (Spack ENVironment) switch environments between sysadmin, users and developers.☆22Jan 4, 2022Updated 4 years ago
- BytePS examples (Vision, NLP, GAN, etc)☆19Nov 24, 2022Updated 3 years ago
- A Library for fast Hash Tables on GPUs☆132Oct 14, 2025Updated 4 months ago
- FPGA-based HyperLogLog Accelerator☆12Jul 13, 2020Updated 5 years ago
- ☆11Jul 9, 2023Updated 2 years ago
- Protobuf and gRPC service definition of treehole.space☆10Mar 27, 2022Updated 3 years ago
- ☆11Apr 3, 2023Updated 2 years ago
- This simulator models multi core systems, intended primarily for studies on main memory management techniques. It models a trace-based ou…☆12Jan 18, 2016Updated 10 years ago
- ☆13Apr 26, 2022Updated 3 years ago
- ☆12Jul 9, 2021Updated 4 years ago
- ☆26Aug 31, 2023Updated 2 years ago
- Systems for ML/AI & ML/AI for Systems paper reading list: A curated reading list of computer science research for work at the intersectio…☆283Jun 9, 2025Updated 8 months ago
- ☆219Aug 17, 2023Updated 2 years ago
- Multiple 1-stencil implementations using nvidia cuda.☆13Dec 2, 2017Updated 8 years ago
- ☆42Sep 8, 2023Updated 2 years ago
- Studying GPU Multi-tenancy☆11Jan 11, 2019Updated 7 years ago
- generic C++ containers; matrix, triangle matrix, crs sparse matrix, etc.☆12Mar 23, 2018Updated 7 years ago
- A study of the downstream instability of word embeddings☆12Aug 23, 2022Updated 3 years ago