Sample Codes using NVSHMEM on Multi-GPU
☆30Jan 22, 2023Updated 3 years ago
Alternatives and similar repositories for NVSHEMEM
Users that are interested in NVSHEMEM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A lightweight design for computation-communication overlap.☆237Jan 20, 2026Updated 4 months ago
- DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling☆27Updated this week
- High-performance GEMM implementation optimized for NVIDIA H100 GPUs, leveraging Hopper architecture's TMA, WGMMA, and Thread Block Cluste…☆11Dec 4, 2024Updated last year
- 🎉My Collections of CUDA Kernels~☆11Jun 25, 2024Updated last year
- Efficient Distributed GPU Programming for Exascale, an SC/ISC Tutorial☆371Updated this week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆24May 26, 2026Updated 3 weeks ago
- A small RISC-V kernel coding by C, tested on sifive unmatched board.☆16Aug 20, 2022Updated 3 years ago
- ☆57Feb 24, 2026Updated 3 months ago
- Website for CSE 234, Winter 2025☆15Mar 24, 2025Updated last year
- ☆122May 16, 2025Updated last year
- Terminal UI for NVIDIA Nsight Systems profiles — timeline viewer, kernel navigator, NVTX hierarchy☆58Updated this week
- NVSHMEM‑Tutorial: Build a DeepEP‑like GPU Buffer☆193Feb 11, 2026Updated 4 months ago
- TiledLower is a Dataflow Analysis and Codegen Framework written in Rust.☆13Nov 23, 2024Updated last year
- Expert Specialization MoE Solution based on CUTLASS☆27Apr 14, 2026Updated 2 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆20May 30, 2026Updated 2 weeks ago
- Benchmark tests supporting the TiledCUDA library.☆19Nov 19, 2024Updated last year
- PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)☆66Mar 24, 2025Updated last year
- TiledKernel is a code generation library based on macro kernels and memory hierarchy graph data structure.☆19May 12, 2024Updated 2 years ago
- ☆13Jan 7, 2025Updated last year
- NCCL Examples from Official NVIDIA NCCL Developer Guide.☆20May 29, 2018Updated 8 years ago
- ring-attention experiments☆167Oct 17, 2024Updated last year
- GPUDirect Async support for IB Verbs☆137Nov 10, 2022Updated 3 years ago
- Several optimization methods of half-precision general matrix vector multiplication (HGEMV) using CUDA core.☆74Sep 8, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- study of cutlass☆22Nov 10, 2024Updated last year
- The official implementation for the intra-stage fusion technique introduced in https://arxiv.org/abs/2409.13221☆31Apr 22, 2025Updated last year
- [NSDI25] AutoCCL: Automated Collective Communication Tuning for Accelerating Distributed and Parallel DNN Training☆32May 2, 2025Updated last year
- Thunder Research Group's Collective Communication Library☆53Jul 8, 2025Updated 11 months ago
- Wave: Python Domain-Specific Language for High Performance Machine Learning☆58Jun 8, 2026Updated last week
- Official Repo of CudaForge☆84Dec 2, 2025Updated 6 months ago
- Framework to reduce autotune overhead to zero for well known deployments.☆101Sep 19, 2025Updated 8 months ago
- ☆14Oct 27, 2023Updated 2 years ago
- Tutorial Exercises and Code for GPU Communications Tutorial at HOT Interconnects 2025☆32Oct 22, 2025Updated 7 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Powerful Rich Vehicle Routing Problem Simulator☆11Jan 25, 2025Updated last year
- A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer☆96Feb 20, 2026Updated 3 months ago
- My Paper Reading Lists and Notes.☆24May 8, 2026Updated last month
- [ICML 2025] This is the official PyTorch implementation of "OmniBal: Towards Fast Instruction-Tuning for Vision-Language Models via Omniv…☆27Jun 16, 2025Updated last year
- PyTorch implementation of the Flash Spectral Transform Unit.☆22Sep 19, 2024Updated last year
- ☆108May 31, 2025Updated last year
- Asynchronous pipeline parallel optimization☆22Feb 2, 2026Updated 4 months ago