Sample Codes using NVSHMEM on Multi-GPU
☆30Jan 22, 2023Updated 3 years ago
Alternatives and similar repositories for NVSHEMEM
Users that are interested in NVSHEMEM are comparing it to the libraries listed below
Sorting:
- A lightweight design for computation-communication overlap.☆223Jan 20, 2026Updated last month
- Persistent dense gemm for Hopper in `CuTeDSL`☆15Aug 9, 2025Updated 6 months ago
- ☆13Jan 7, 2025Updated last year
- ☆23Jul 11, 2025Updated 7 months ago
- Expert Specialization MoE Solution based on CUTLASS☆27Jan 19, 2026Updated last month
- ☆16Feb 24, 2026Updated last week
- Website for CSE 234, Winter 2025☆13Mar 24, 2025Updated 11 months ago
- DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling☆21Feb 9, 2026Updated last month
- Benchmark tests supporting the TiledCUDA library.☆18Nov 19, 2024Updated last year
- ☆116May 16, 2025Updated 9 months ago
- ☆53Feb 24, 2026Updated last week
- PyTorch implementation of the Flash Spectral Transform Unit.☆22Sep 19, 2024Updated last year
- TiledLower is a Dataflow Analysis and Codegen Framework written in Rust.☆14Nov 23, 2024Updated last year
- PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)☆66Mar 24, 2025Updated 11 months ago
- Wave: Python Domain-Specific Language for High Performance Machine Learning☆45Updated this week
- A small RISC-V kernel coding by C, tested on sifive unmatched board.☆16Aug 20, 2022Updated 3 years ago
- ☆39Dec 14, 2025Updated 2 months ago
- TiledKernel is a code generation library based on macro kernels and memory hierarchy graph data structure.☆19May 12, 2024Updated last year
- Pure Triton kernels for Qwen3.5-27B inference on NVIDIA B200☆66Feb 28, 2026Updated last week
- Efficient Distributed GPU Programming for Exascale, an SC/ISC Tutorial☆353Dec 3, 2025Updated 3 months ago
- study of cutlass☆22Nov 10, 2024Updated last year
- NVSHMEM‑Tutorial: Build a DeepEP‑like GPU Buffer☆165Feb 11, 2026Updated 3 weeks ago
- A GPU FP32 computation method with Tensor Cores.☆26Dec 8, 2025Updated 3 months ago
- ☆45Feb 27, 2026Updated last week
- NCCL Examples from Official NVIDIA NCCL Developer Guide.☆20May 29, 2018Updated 7 years ago
- Awesome code, projects, books, etc. related to CUDA☆31Feb 3, 2026Updated last month
- My Paper Reading Lists and Notes.☆21Feb 17, 2026Updated 2 weeks ago
- Framework to reduce autotune overhead to zero for well known deployments.☆97Sep 19, 2025Updated 5 months ago
- Thunder Research Group's Collective Communication Library☆47Jul 8, 2025Updated 8 months ago
- Official Repo of CudaForge☆62Dec 2, 2025Updated 3 months ago
- SpInfer: Leveraging Low-Level Sparsity for Efficient Large Language Model Inference on GPUs☆60Mar 25, 2025Updated 11 months ago
- A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer☆96Feb 20, 2026Updated 2 weeks ago
- ☆88May 31, 2025Updated 9 months ago
- ring-attention experiments☆166Oct 17, 2024Updated last year
- [HPCA 2026] A GPU-optimized system for efficient long-context LLMs decoding with low-bit KV cache.☆81Dec 18, 2025Updated 2 months ago
- The official implementation for the intra-stage fusion technique introduced in https://arxiv.org/abs/2409.13221☆31Apr 22, 2025Updated 10 months ago
- ☆116Updated this week
- ☆42Nov 1, 2025Updated 4 months ago
- [DEPRECATED] Moved to ROCm/rocm-systems repo☆145Feb 23, 2026Updated last week