Sample Codes using NVSHMEM on Multi-GPU
☆30Jan 22, 2023Updated 3 years ago
Alternatives and similar repositories for NVSHEMEM
Users that are interested in NVSHEMEM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A lightweight design for computation-communication overlap.☆226Jan 20, 2026Updated 2 months ago
- DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling☆22Apr 9, 2026Updated last week
- High-performance GEMM implementation optimized for NVIDIA H100 GPUs, leveraging Hopper architecture's TMA, WGMMA, and Thread Block Cluste…☆10Dec 4, 2024Updated last year
- Persistent dense gemm for Hopper in `CuTeDSL`☆15Aug 9, 2025Updated 8 months ago
- 🎉My Collections of CUDA Kernels~☆11Jun 25, 2024Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Efficient Distributed GPU Programming for Exascale, an SC/ISC Tutorial☆356Mar 27, 2026Updated 3 weeks ago
- ☆23Apr 7, 2026Updated last week
- A small RISC-V kernel coding by C, tested on sifive unmatched board.☆16Aug 20, 2022Updated 3 years ago
- Website for CSE 234, Winter 2025☆13Mar 24, 2025Updated last year
- ☆119May 16, 2025Updated 11 months ago
- ☆57Feb 24, 2026Updated last month
- NVSHMEM‑Tutorial: Build a DeepEP‑like GPU Buffer☆177Feb 11, 2026Updated 2 months ago
- TiledLower is a Dataflow Analysis and Codegen Framework written in Rust.☆13Nov 23, 2024Updated last year
- Expert Specialization MoE Solution based on CUTLASS☆26Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆18Updated this week
- PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)☆66Mar 24, 2025Updated last year
- Benchmark tests supporting the TiledCUDA library.☆18Nov 19, 2024Updated last year
- TiledKernel is a code generation library based on macro kernels and memory hierarchy graph data structure.☆19May 12, 2024Updated last year
- ☆13Jan 7, 2025Updated last year
- NCCL Examples from Official NVIDIA NCCL Developer Guide.☆20May 29, 2018Updated 7 years ago
- ring-attention experiments☆165Oct 17, 2024Updated last year
- Several optimization methods of half-precision general matrix vector multiplication (HGEMV) using CUDA core.☆74Sep 8, 2024Updated last year
- Official Repo of CudaForge☆76Dec 2, 2025Updated 4 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- The official implementation for the intra-stage fusion technique introduced in https://arxiv.org/abs/2409.13221☆31Apr 22, 2025Updated 11 months ago
- study of cutlass☆22Nov 10, 2024Updated last year
- [NSDI25] AutoCCL: Automated Collective Communication Tuning for Accelerating Distributed and Parallel DNN Training☆31May 2, 2025Updated 11 months ago
- Thunder Research Group's Collective Communication Library☆51Jul 8, 2025Updated 9 months ago
- Wave: Python Domain-Specific Language for High Performance Machine Learning☆53Updated this week
- Framework to reduce autotune overhead to zero for well known deployments.☆99Sep 19, 2025Updated 6 months ago
- ☆13Jan 28, 2026Updated 2 months ago
- Tutorial Exercises and Code for GPU Communications Tutorial at HOT Interconnects 2025☆31Oct 22, 2025Updated 5 months ago
- A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer☆97Feb 20, 2026Updated last month
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- My Paper Reading Lists and Notes.☆21Mar 28, 2026Updated 3 weeks ago
- PyTorch implementation of the Flash Spectral Transform Unit.☆22Sep 19, 2024Updated last year
- ☆98May 31, 2025Updated 10 months ago
- Asynchronous pipeline parallel optimization☆21Feb 2, 2026Updated 2 months ago
- Pure Triton kernels for Qwen3.5-27B inference on NVIDIA B200☆98Feb 28, 2026Updated last month
- AMPL model for the dependable dynamic vehicle routing problem, published in RSSRail 2017☆10Jul 16, 2020Updated 5 years ago
- Awesome code, projects, books, etc. related to CUDA☆32Mar 30, 2026Updated 2 weeks ago