π A curated list of awesome matrix-matrix multiplication (A * B = C) frameworks, libraries and software
β69Feb 23, 2025Updated last year
Alternatives and similar repositories for awesome-gemm
Users that are interested in awesome-gemm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- vLLM Model plugin for the encoder-decoder BART modelβ13Oct 23, 2026Updated last week
- FLA but cuTileβ27Apr 17, 2026Updated 6 months ago
- A curated collection of resources, tutorials, and best practices for learning and mastering NVIDIA CUTLASSβ275May 6, 2025Updated last year
- Accelerating LLM inference with techniques like speculative decoding, quantization, and kernel fusion, focusing on implementing state-of-β¦β11Jul 1, 2025Updated last year
- A Toy-Purpose TPU Simulatorβ24Jun 7, 2024Updated 2 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI β’ AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- CUDA 8-bit Tensor Core Matrix Multiplication based on m16n16k16 WMMA APIβ38Sep 15, 2023Updated 3 years ago
- High Performance FP8 GEMM Kernels for SM89 and later GPUs.β21Jan 24, 2025Updated last year
- FlashTile is a CUDA Tile IR compiler that is compatible with NVIDIA's tileiras, targeting SM70 through SM121 NVIDIA GPUs.β62Feb 6, 2026Updated 8 months ago
- Easy recipes to speed up latency of Flux, QwenImage, and LTX-2 with NVFP4 and MXFP8 on Blackwell.β14Apr 10, 2026Updated 6 months ago
- β12Jun 10, 2026Updated 4 months ago
- SGLang wheels for multiple platformsβ11Oct 13, 2025Updated last year
- Autonomous GPU kernel optimization system driven by AI agents.β32Mar 29, 2026Updated 7 months ago
- Learnings + Exercises from the PMPP book!β11Mar 1, 2026Updated 8 months ago
- A Triton JIT runtime and ffi provider in C++β41Sep 24, 2026Updated last month
- Simple, predictable pricing with DigitalOcean hosting β’ AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- VHDL design for rotary encoder. Can be used accessed via digital signals or AXI interface.β13Mar 24, 2017Updated 9 years ago
- Lab assignments for the Agile Hardware Design courseβ19Nov 14, 2025Updated 11 months ago
- Fast CUDA matrix multiplication from scratchβ1,349Sep 2, 2025Updated last year
- β67Feb 15, 2026Updated 8 months ago
- NCCL Examples from Official NVIDIA NCCL Developer Guide.β21May 29, 2018Updated 8 years ago
- fused MoE kernel in Candle backendβ14Feb 3, 2026Updated 9 months ago
- nvc + xsim = encrypted IP and, quite possibly, eternal gloryβ24Oct 27, 2026Updated last week
- β28May 9, 2025Updated last year
- β‘οΈQwen-Image 4.8xπ speedup with Hybrid Acceleration for low VRAM GPUsβ17Oct 24, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer β’ AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- (ToCa-v2) A New version of ToCaοΌwith faster speed and better acceleration!β43Mar 13, 2025Updated last year
- (ECCV 2026): Official code for Flash-BoN: Instant Drafts for Inference-Time Scaling in Diffusion Modelsβ25Jul 9, 2026Updated 3 months ago
- Abliterated DeepSeek-V4.1-Flash-1017 (FP8 dense, FP4 experts) on 4x RTX PRO 6000 with vLLM-Moet r21 and DSpark: 371-376 tok/s single-streβ¦β31Oct 28, 2026Updated last week
- Automated bottleneck detection and solution orchestrationβ23Feb 24, 2026Updated 8 months ago
- GPT2 in handwritten PTXβ16Jun 29, 2025Updated last year
- πππ This repository lists some awesome public CUDA, cuda-python, cuBLAS, cuDNN, CUTLASS, TensorRT, TensorRT-LLM, Triton, TVM, MLIR, PTβ¦β524Aug 2, 2025Updated last year
- collection of benchmarks to measure basic GPU capabilitiesβ542Oct 24, 2025Updated last year
- KsanaDiT: High-Performance DiT (Diffusion Transformer) Inference Framework for Video & Image Generationβ64May 13, 2026Updated 5 months ago
- initialize rust structs using environment variables (like pydantic's BaseSettings)β12Oct 26, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer β’ AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- β123May 16, 2025Updated last year
- β271Jul 11, 2024Updated 2 years ago
- β22May 30, 2026Updated 5 months ago
- A repository where GPU applications are aggregated using a common build flow that supports multiple CUDA versions.β95Oct 26, 2026Updated last week
- [DEPRECATED] Moved to ROCm/rocm-libraries repoβ143Updated this week
- β22Apr 7, 2026Updated 6 months ago
- OHWR's websiteβ16Oct 26, 2026Updated last week