Quentin-Anthony / nanoMPILinks
Simple MPI implementation for prototyping or learning
☆284Updated 2 months ago
Alternatives and similar repositories for nanoMPI
Users that are interested in nanoMPI are comparing it to the libraries listed below
Sorting:
- Learning about CUDA by writing PTX code.☆138Updated last year
- Home for "How To Scale Your Model", a short blog-style textbook about scaling LLMs on TPUs☆650Updated this week
- A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.☆420Updated 6 months ago
- Learn CUDA with PyTorch☆85Updated 2 weeks ago
- A curated collection of resources, tutorials, and best practices for learning and mastering NVIDIA CUTLASS☆230Updated 5 months ago
- A repository to unravel the language of GPUs, making their kernel conversations easy to understand☆194Updated 4 months ago
- PyTorch Single Controller☆435Updated this week
- ☆173Updated last year
- Quantized LLM training in pure CUDA/C++.☆180Updated this week
- A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.☆577Updated last month
- FlexAttention based, minimal vllm-style inference engine for fast Gemma 2 inference.☆290Updated 2 months ago
- Small scale distributed training of sequential deep learning models, built on Numpy and MPI.☆143Updated last year
- Dion optimizer algorithm☆361Updated last week
- Learnings and programs related to CUDA☆419Updated 3 months ago
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)☆414Updated last week
- KernelBench: Can LLMs Write GPU Kernels? - Benchmark with Torch -> CUDA problems☆592Updated this week
- ☆222Updated last week
- PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)☆66Updated 6 months ago
- The Tensor (or Array)☆449Updated last year
- UNet diffusion model in pure CUDA☆649Updated last year
- ☆206Updated 9 months ago
- Cataloging released Triton kernels.☆261Updated last month
- ☆78Updated 2 weeks ago
- High-Performance SGEMM on CUDA devices☆105Updated 8 months ago
- Fastest kernels written from scratch☆366Updated 3 weeks ago
- ☆242Updated last week
- Write a fast kernel and run it on Discord. See how you compare against the best!☆58Updated last week
- ring-attention experiments☆152Updated 11 months ago
- Complete solutions to the Programming Massively Parallel Processors Edition 4☆533Updated 3 months ago
- Official Problem Sets / Reference Kernels for the GPU MODE Leaderboard!☆97Updated last week