Quentin-Anthony / nanoMPILinks
Simple MPI implementation for prototyping or learning
☆279Updated 3 weeks ago
Alternatives and similar repositories for nanoMPI
Users that are interested in nanoMPI are comparing it to the libraries listed below
Sorting:
- Home for "How To Scale Your Model", a short blog-style textbook about scaling LLMs on TPUs☆562Updated this week
- A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.☆391Updated 5 months ago
- Learning about CUDA by writing PTX code.☆135Updated last year
- A repository to unravel the language of GPUs, making their kernel conversations easy to understand☆191Updated 2 months ago
- The Tensor (or Array)☆441Updated last year
- A curated collection of resources, tutorials, and best practices for learning and mastering NVIDIA CUTLASS☆214Updated 3 months ago
- A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.☆571Updated 2 weeks ago
- PyTorch Single Controller☆368Updated this week
- UNet diffusion model in pure CUDA☆648Updated last year
- Learnings and programs related to CUDA☆415Updated 2 months ago
- ☆163Updated last year
- Official Problem Sets / Reference Kernels for the GPU MODE Leaderboard!☆74Updated this week
- ☆192Updated 7 months ago
- ☆214Updated 6 months ago
- Cataloging released Triton kernels.☆252Updated 7 months ago
- PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)☆66Updated 5 months ago
- High-Performance SGEMM on CUDA devices☆97Updated 7 months ago
- Alex Krizhevsky's original code from Google Code☆196Updated 9 years ago
- ☆232Updated last week
- KernelBench: Can LLMs Write GPU Kernels? - Benchmark with Torch -> CUDA problems☆537Updated this week
- FlexAttention based, minimal vllm-style inference engine for fast Gemma 2 inference.☆261Updated 3 weeks ago
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)☆389Updated 2 weeks ago
- Where GPUs get cooked 👩🍳🔥☆279Updated 3 weeks ago
- (WIP) A small but powerful, homemade PyTorch from scratch.☆623Updated this week
- ☆527Updated last year
- Dion optimizer algorithm☆318Updated last week
- Small scale distributed training of sequential deep learning models, built on Numpy and MPI.☆136Updated last year
- Implementation of Diffusion Transformer (DiT) in JAX☆292Updated last year
- Learn CUDA with PyTorch☆67Updated this week
- ☆478Updated 3 weeks ago