Tutorial Exercises and Code for GPU Communications Tutorial at HOT Interconnects 2026
☆50Sep 28, 2026Updated last month
Alternatives and similar repositories for hoti-gpu-comms-tutorial
Users that are interested in hoti-gpu-comms-tutorial are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- NVIDIA NVSHMEM is a parallel programming interface for NVIDIA GPUs based on OpenSHMEM. NVSHMEM can significantly reduce multi-process com…☆605Oct 28, 2026Updated 2 weeks ago
- ☆146May 10, 2026Updated 6 months ago
- ☆46Oct 15, 2025Updated last year
- NVSHMEM‑Tutorial: Build a DeepEP‑like GPU Buffer☆208Feb 11, 2026Updated 9 months ago
- ☆97Feb 5, 2026Updated 9 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Experiments, results, and misc. scripts.☆34Oct 2, 2026Updated last month
- GPU kernel benchmarking☆52Oct 10, 2026Updated last month
- A high-performance, RDMA-native data-plane library for large-scale heterogeneous memory pools, developed by the Tencent Astral Network Te…☆35Aug 6, 2026Updated 3 months ago
- My tests and experiments with some popular dl frameworks.☆17Sep 11, 2025Updated last year
- (deprecated) torchcomms: a modern PyTorch communications API☆405Nov 4, 2026Updated last week
- A NCCL extension library, designed to efficiently offload GPU memory allocated by the NCCL communication library.☆123Dec 17, 2025Updated 10 months ago
- Tile-based language built for AI computation across all scales☆197Aug 25, 2026Updated 2 months ago
- pytorch code examples for measuring the performance of collective communication calls in AI workloads☆21Sep 18, 2025Updated last year
- ☆37Aug 7, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Efficient and unified implementations for TopK-based sparse attention☆41Jul 10, 2026Updated 4 months ago
- htop-like TUI for real-time RDMA network monitoring.☆129Updated this week
- Paged Attention, Prefix Caching, Continuous Batching and Serving in one file☆29Nov 4, 2026Updated last week
- ☆32Jul 2, 2025Updated last year
- A collection of specialized agent skills for AI infrastructure development, enabling Claude Code to write, optimize, and debug high-perfo…☆158Jul 9, 2026Updated 4 months ago
- Reference implementation and examples of the CuTe Layout representation and algebra.☆396Nov 3, 2026Updated last week
- ☆55Oct 22, 2026Updated 3 weeks ago
- High-performance distributed data shuffling (all-to-all) library for MoE training and inference☆127Mar 7, 2026Updated 8 months ago
- ☆51Aug 17, 2026Updated 2 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Linux kernel device driver supporting AWS Neuron SDK☆14Oct 19, 2026Updated 3 weeks ago
- ☆11Oct 29, 2026Updated 2 weeks ago
- PegaFlow is a high-performance KV cache offloading solution for vLLM v1 on single-node multi-GPU setups.☆25Jan 7, 2026Updated 10 months ago
- mKernel: fast multi-node, multi-GPU fused kernels☆309Oct 17, 2026Updated 3 weeks ago
- nvloom is a set of tools designed to scalably test MNNVL fabrics.☆67Oct 19, 2026Updated 3 weeks ago
- Ongoing research training transformer models at scale☆13Nov 5, 2026Updated last week
- RDMA and SHARP plugins for nccl library☆234Oct 29, 2026Updated 2 weeks ago
- Unified tracing profiler and visualizer, one timeline from CPU to GPU/HES to in-kernel zones☆152Sep 21, 2026Updated last month
- Open source version of DOCA GPUNetIO and DOCA Verbs libraries (limited features) to enable GDAKI technology on RDMA (IB and RoCE)☆76Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Communication patterns for AI, built on top of NCCL device and host APIs☆78Updated this week
- The repo for the article: CSPG: Crossing Sparse Proximity Graphs for Approximate Nearest Neighbor Search☆12Dec 12, 2024Updated last year
- Network-Accelerated Distributed Deep Learning☆10Sep 13, 2021Updated 5 years ago
- ROCm Driver RDMA Peer to Peer Support☆22Mar 21, 2019Updated 7 years ago
- ☆11Nov 11, 2025Updated last year
- ☆11Mar 27, 2025Updated last year
- UCCL is an efficient communication library for GPUs, covering collectives, P2P (e.g., KV cache transfer, RL weight transfer), and EP (e.g…☆1,582Updated this week
Are these results useful?