Quentin-Anthony / nanoMPILinks
Simple MPI implementation for prototyping or learning
☆286Updated 2 months ago
Alternatives and similar repositories for nanoMPI
Users that are interested in nanoMPI are comparing it to the libraries listed below
Sorting:
- A repository to unravel the language of GPUs, making their kernel conversations easy to understand☆194Updated 4 months ago
- Learning about CUDA by writing PTX code.☆145Updated last year
- Home for "How To Scale Your Model", a short blog-style textbook about scaling LLMs on TPUs☆666Updated last week
- A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.☆425Updated 7 months ago
- The Tensor (or Array)☆451Updated last year
- Quantized LLM training in pure CUDA/C++.☆209Updated this week
- FlexAttention based, minimal vllm-style inference engine for fast Gemma 2 inference.☆300Updated 2 months ago
- A curated collection of resources, tutorials, and best practices for learning and mastering NVIDIA CUTLASS☆233Updated 5 months ago
- Learn CUDA with PyTorch☆95Updated last month
- Learnings and programs related to CUDA☆422Updated 4 months ago
- A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.☆580Updated 2 months ago
- ☆174Updated last year
- PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)☆66Updated 7 months ago
- Small scale distributed training of sequential deep learning models, built on Numpy and MPI.☆146Updated 2 years ago
- UNet diffusion model in pure CUDA☆651Updated last year
- Dion optimizer algorithm☆374Updated last month
- ☆224Updated last week
- Cataloging released Triton kernels.☆263Updated last month
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)☆436Updated last week
- (WIP) A small but powerful, homemade PyTorch from scratch.☆643Updated last week
- A Quirky Assortment of CuTe Kernels☆637Updated 2 weeks ago
- ☆242Updated this week
- KernelBench: Can LLMs Write GPU Kernels? - Benchmark with Torch -> CUDA problems☆632Updated last week
- Official Problem Sets / Reference Kernels for the GPU MODE Leaderboard!☆98Updated 2 weeks ago
- Simple Byte pair Encoding mechanism used for tokenization process . written purely in C☆137Updated 11 months ago
- Complete solutions to the Programming Massively Parallel Processors Edition 4☆556Updated 4 months ago
- ☆516Updated 2 months ago
- ☆81Updated this week
- GPU documentation for humans☆348Updated 3 weeks ago
- ring-attention experiments☆155Updated last year