modal-labs / gpu-glossaryLinks
GPU documentation for humans
☆514Updated last week
Alternatives and similar repositories for gpu-glossary
Users that are interested in gpu-glossary are comparing it to the libraries listed below
Sorting:
- Yet Another Language Model: LLM inference in C++/CUDA, no libraries except for I/O☆550Updated 4 months ago
- Simple MPI implementation for prototyping or learning☆300Updated 6 months ago
- Complete solutions to the Programming Massively Parallel Processors Edition 4☆655Updated 7 months ago
- Fastest kernels written from scratch☆532Updated 4 months ago
- ☆129Updated 3 months ago
- Perplexity GPU Kernels☆554Updated 2 months ago
- Helpful kernel tutorials and examples for tile-based GPU programming☆617Updated last week
- A curated collection of resources, tutorials, and best practices for learning and mastering NVIDIA CUTLASS☆249Updated 8 months ago
- Learn CUDA with PyTorch☆193Updated this week
- CUDA Tile IR is an MLIR-based intermediate representation and compiler infrastructure for CUDA kernel optimization, focusing on tile-base…☆804Updated 3 weeks ago
- Official Problem Sets / Reference Kernels for the GPU MODE Leaderboard!☆200Updated this week
- kernels, of the mega variety☆665Updated last week
- NVIDIA NVSHMEM is a parallel programming interface for NVIDIA GPUs based on OpenSHMEM. NVSHMEM can significantly reduce multi-process com…☆461Updated last month
- Quantized LLM training in pure CUDA/C++.☆235Updated 2 weeks ago
- TritonParse: A Compiler Tracer, Visualizer, and Reproducer for Triton Kernels☆189Updated last week
- A curriculum for learning about gpu performance engineering, from scratch to what the frontier AI labs do☆341Updated 3 weeks ago
- Learning about CUDA by writing PTX code.☆151Updated last year
- torchcomms: a modern PyTorch communications API☆327Updated this week
- ☆90Updated last month
- A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.☆457Updated 10 months ago
- An early research stage expert-parallel load balancer for MoE models based on linear programming.☆495Updated 2 months ago
- Home for "How To Scale Your Model", a short blog-style textbook about scaling LLMs on TPUs☆827Updated last week
- Tilus is a tile-level kernel programming language with explicit control over shared memory and registers.☆440Updated last month
- A Quirky Assortment of CuTe Kernels☆781Updated this week
- Perplexity open source garden for inference technology☆359Updated last month
- Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serv…☆260Updated last week
- ☆991Updated this week
- ☆286Updated this week
- PyTorch Single Controller☆957Updated this week
- Our first fully AI generated deep learning system☆429Updated 2 weeks ago