modal-labs / gpu-glossaryLinks
GPU documentation for humans
☆501Updated this week
Alternatives and similar repositories for gpu-glossary
Users that are interested in gpu-glossary are comparing it to the libraries listed below
Sorting:
- Yet Another Language Model: LLM inference in C++/CUDA, no libraries except for I/O☆547Updated 4 months ago
- Simple MPI implementation for prototyping or learning☆299Updated 5 months ago
- Fastest kernels written from scratch☆523Updated 3 months ago
- ☆128Updated 2 months ago
- Helpful kernel tutorials and examples for tile-based GPU programming☆568Updated this week
- Official Problem Sets / Reference Kernels for the GPU MODE Leaderboard!☆188Updated 3 weeks ago
- NVIDIA NVSHMEM is a parallel programming interface for NVIDIA GPUs based on OpenSHMEM. NVSHMEM can significantly reduce multi-process com…☆443Updated 2 weeks ago
- A curated collection of resources, tutorials, and best practices for learning and mastering NVIDIA CUTLASS☆247Updated 8 months ago
- Learning about CUDA by writing PTX code.☆151Updated last year
- A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.☆453Updated 10 months ago
- Perplexity GPU Kernels☆552Updated 2 months ago
- Learn CUDA with PyTorch☆176Updated 3 weeks ago
- An early research stage expert-parallel load balancer for MoE models based on linear programming.☆485Updated last month
- Quantized LLM training in pure CUDA/C++.☆231Updated this week
- Complete solutions to the Programming Massively Parallel Processors Edition 4☆635Updated 6 months ago
- kernels, of the mega variety☆648Updated 3 months ago
- CUDA Tile IR is an MLIR-based intermediate representation and compiler infrastructure for CUDA kernel optimization, focusing on tile-base…☆773Updated this week
- TritonParse: A Compiler Tracer, Visualizer, and Reproducer for Triton Kernels☆185Updated this week
- ☆87Updated last month
- Tilus is a tile-level kernel programming language with explicit control over shared memory and registers.☆439Updated last month
- ☆88Updated 2 months ago
- ☆271Updated this week
- torchcomms: a modern PyTorch communications API☆320Updated this week
- Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serv…☆251Updated this week
- Fast low-bit matmul kernels in Triton☆423Updated 3 weeks ago
- A Quirky Assortment of CuTe Kernels☆749Updated this week
- Cataloging released Triton kernels.☆282Updated 4 months ago
- Home for "How To Scale Your Model", a short blog-style textbook about scaling LLMs on TPUs☆807Updated this week
- PyTorch Single Controller☆948Updated this week
- A Python-embedded DSL that makes it easy to write fast, scalable ML kernels with minimal boilerplate.☆711Updated this week