modal-labs / gpu-glossaryLinks
GPU documentation for humans
☆419Updated 2 weeks ago
Alternatives and similar repositories for gpu-glossary
Users that are interested in gpu-glossary are comparing it to the libraries listed below
Sorting:
- Yet Another Language Model: LLM inference in C++/CUDA, no libraries except for I/O☆539Updated 3 months ago
- Simple MPI implementation for prototyping or learning☆293Updated 4 months ago
- ☆86Updated last month
- Fastest kernels written from scratch☆499Updated 3 months ago
- Helpful kernel tutorials and examples for tile-based GPU programming☆456Updated this week
- NVIDIA NVSHMEM is a parallel programming interface for NVIDIA GPUs based on OpenSHMEM. NVSHMEM can significantly reduce multi-process com…☆425Updated this week
- Learning about CUDA by writing PTX code.☆150Updated last year
- A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.☆444Updated 9 months ago
- ☆81Updated last week
- A curated collection of resources, tutorials, and best practices for learning and mastering NVIDIA CUTLASS☆244Updated 7 months ago
- Quantized LLM training in pure CUDA/C++.☆224Updated this week
- ☆127Updated 2 months ago
- Official Problem Sets / Reference Kernels for the GPU MODE Leaderboard!☆177Updated this week
- An early research stage expert-parallel load balancer for MoE models based on linear programming.☆469Updated last month
- Complete solutions to the Programming Massively Parallel Processors Edition 4☆608Updated 6 months ago
- kernels, of the mega variety☆631Updated 2 months ago
- TritonParse: A Compiler Tracer, Visualizer, and Reproducer for Triton Kernels☆178Updated this week
- Perplexity GPU Kernels☆542Updated last month
- torchcomms: a modern PyTorch communications API☆309Updated last week
- CUDA Tile IR is an MLIR-based intermediate representation and compiler infrastructure for CUDA kernel optimization, focusing on tile-base…☆195Updated this week
- Tilus is a tile-level kernel programming language with explicit control over shared memory and registers.☆433Updated last week
- Hand-Rolled GPU communications library☆76Updated last month
- ☆263Updated this week
- Learn CUDA with PyTorch☆138Updated this week
- Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serv…☆249Updated 2 weeks ago
- A Python-embedded DSL that makes it easy to write fast, scalable ML kernels with minimal boilerplate.☆691Updated this week
- A Quirky Assortment of CuTe Kernels☆701Updated last week
- High-Performance SGEMM on CUDA devices☆113Updated 11 months ago
- Fast low-bit matmul kernels in Triton☆410Updated last week
- Home for "How To Scale Your Model", a short blog-style textbook about scaling LLMs on TPUs☆781Updated this week