modal-labs / gpu-glossaryLinks
GPU documentation for humans
☆393Updated this week
Alternatives and similar repositories for gpu-glossary
Users that are interested in gpu-glossary are comparing it to the libraries listed below
Sorting:
- Yet Another Language Model: LLM inference in C++/CUDA, no libraries except for I/O☆531Updated 2 months ago
- NVIDIA NVSHMEM is a parallel programming interface for NVIDIA GPUs based on OpenSHMEM. NVSHMEM can significantly reduce multi-process com…☆377Updated last month
- ☆123Updated 3 weeks ago
- Official Problem Sets / Reference Kernels for the GPU MODE Leaderboard!☆140Updated this week
- Simple MPI implementation for prototyping or learning☆287Updated 3 months ago
- Learning about CUDA by writing PTX code.☆147Updated last year
- ☆81Updated this week
- TritonParse: A Compiler Tracer, Visualizer, and Reproducer for Triton Kernels☆171Updated this week
- Tilus is a tile-level kernel programming language with explicit control over shared memory and registers.☆396Updated last week
- A curated collection of resources, tutorials, and best practices for learning and mastering NVIDIA CUTLASS☆242Updated 6 months ago
- LeetGPU Challenges☆459Updated this week
- CPU inference for the DeepSeek family of large language models in C++☆315Updated last month
- Complete solutions to the Programming Massively Parallel Processors Edition 4☆571Updated 4 months ago
- kernels, of the mega variety☆599Updated last month
- Perplexity GPU Kernels☆528Updated last week
- A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.☆428Updated 8 months ago
- Home for "How To Scale Your Model", a short blog-style textbook about scaling LLMs on TPUs☆683Updated this week
- Quantized LLM training in pure CUDA/C++.☆215Updated this week
- torchcomms: a modern PyTorch communications API☆278Updated this week
- Fastest kernels written from scratch☆391Updated last month
- Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serv…☆230Updated this week
- Competitive GPU kernel optimization platform.☆134Updated this week
- High-Performance SGEMM on CUDA devices☆110Updated 9 months ago
- Fast low-bit matmul kernels in Triton☆395Updated 3 weeks ago
- Cataloging released Triton kernels.☆265Updated 2 months ago
- PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)☆66Updated 7 months ago
- Hand-Rolled GPU communications library☆58Updated this week
- ☆63Updated this week
- Learnings and programs related to CUDA☆426Updated 4 months ago
- Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond☆628Updated last week