Sample Codes using NVSHMEM on Multi-GPU
☆30Jan 22, 2023Updated 3 years ago
Alternatives and similar repositories for NVSHEMEM
Users that are interested in NVSHEMEM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A lightweight design for computation-communication overlap.☆240Jan 20, 2026Updated 5 months ago
- DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling☆29Jun 30, 2026Updated last week
- High-performance GEMM implementation optimized for NVIDIA H100 GPUs, leveraging Hopper architecture's TMA, WGMMA, and Thread Block Cluste…☆11Dec 4, 2024Updated last year
- 🎉My Collections of CUDA Kernels~☆11Jun 25, 2024Updated 2 years ago
- Efficient Distributed GPU Programming for Exascale, an SC/ISC Tutorial☆380Jun 26, 2026Updated last week
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- A small RISC-V kernel coding by C, tested on sifive unmatched board.☆16Aug 20, 2022Updated 3 years ago
- ☆24May 26, 2026Updated last month
- ☆60Feb 24, 2026Updated 4 months ago
- Website for CSE 234, Winter 2025☆16Mar 24, 2025Updated last year
- ☆121May 16, 2025Updated last year
- Terminal UI for NVIDIA Nsight Systems profiles — timeline viewer, kernel navigator, NVTX hierarchy☆62Jun 18, 2026Updated 3 weeks ago
- NVSHMEM‑Tutorial: Build a DeepEP‑like GPU Buffer☆194Feb 11, 2026Updated 4 months ago
- TiledLower is a Dataflow Analysis and Codegen Framework written in Rust.☆13Nov 23, 2024Updated last year
- Expert Specialization MoE Solution based on CUTLASS☆27Apr 14, 2026Updated 2 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆20May 30, 2026Updated last month
- Benchmark tests supporting the TiledCUDA library.☆19Nov 19, 2024Updated last year
- PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)☆66Mar 24, 2025Updated last year
- TiledKernel is a code generation library based on macro kernels and memory hierarchy graph data structure.☆19May 12, 2024Updated 2 years ago
- ☆13Jan 7, 2025Updated last year
- NCCL Examples from Official NVIDIA NCCL Developer Guide.☆21May 29, 2018Updated 8 years ago
- ring-attention experiments☆169Oct 17, 2024Updated last year
- GPUDirect Async support for IB Verbs☆138Nov 10, 2022Updated 3 years ago
- Several optimization methods of half-precision general matrix vector multiplication (HGEMV) using CUDA core.☆75Sep 8, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- study of cutlass☆22Nov 10, 2024Updated last year
- The official implementation for the intra-stage fusion technique introduced in https://arxiv.org/abs/2409.13221☆31Apr 22, 2025Updated last year
- [NSDI25] AutoCCL: Automated Collective Communication Tuning for Accelerating Distributed and Parallel DNN Training☆32May 2, 2025Updated last year
- Thunder Research Group's Collective Communication Library☆53Jul 8, 2025Updated last year
- Wave: Python Domain-Specific Language for High Performance Machine Learning☆58Jun 29, 2026Updated last week
- Official Repo of CudaForge☆84Dec 2, 2025Updated 7 months ago
- Framework to reduce autotune overhead to zero for well known deployments.☆101Sep 19, 2025Updated 9 months ago
- ☆13Jun 14, 2026Updated 3 weeks ago
- Tutorial Exercises and Code for GPU Communications Tutorial at HOT Interconnects 2025☆32Oct 22, 2025Updated 8 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer☆96Jun 21, 2026Updated 2 weeks ago
- My Paper Reading Lists and Notes.☆24May 8, 2026Updated 2 months ago
- [ICML 2025] This is the official PyTorch implementation of "OmniBal: Towards Fast Instruction-Tuning for Vision-Language Models via Omniv…☆27Jun 16, 2025Updated last year
- PyTorch implementation of the Flash Spectral Transform Unit.☆22Sep 19, 2024Updated last year
- ☆110May 31, 2025Updated last year
- Asynchronous pipeline parallel optimization☆22Feb 2, 2026Updated 5 months ago
- Analysis for the traces from byteprofile☆32Nov 21, 2023Updated 2 years ago