☆91Feb 29, 2024Updated 2 years ago
Alternatives and similar repositories for inference-optimization-blog-post
Users that are interested in inference-optimization-blog-post are comparing it to the libraries listed below
Sorting:
- ☆12Jan 4, 2024Updated 2 years ago
- ring-attention experiments☆165Oct 17, 2024Updated last year
- ☆93Jul 5, 2024Updated last year
- Supporting code for "LLMs for your iPhone: Whole-Tensor 4 Bit Quantization"☆11Mar 31, 2024Updated last year
- Cataloging released Triton kernels.☆295Sep 9, 2025Updated 5 months ago
- MSLK (Meta Superintelligence Labs Kernels) is a collection of PyTorch GPU operator libraries that are designed and optimized for GenAI tr…☆55Updated this week
- Mixed precision training from scratch with Tensors and CUDA☆28May 14, 2024Updated last year
- BFloat16 Fused Adam Operator for PyTorch☆16Nov 16, 2024Updated last year
- Persistent dense gemm for Hopper in `CuTeDSL`☆15Aug 9, 2025Updated 6 months ago
- ☆23Jul 11, 2025Updated 7 months ago
- ☆12Nov 18, 2023Updated 2 years ago
- Experimental GPU language with meta-programming☆26Sep 6, 2024Updated last year
- ☆15Feb 24, 2026Updated last week
- Standalone commandline CLI tool for compiling Triton kernels☆20Sep 13, 2024Updated last year
- Cute layout visualization☆30Jan 18, 2026Updated last month
- Learn CUDA with PyTorch☆231Feb 23, 2026Updated last week
- ☆12Jun 27, 2024Updated last year
- Continual Multi-agent Reinforcement Learning in Dynamic Environments☆11Jul 1, 2021Updated 4 years ago
- Repository for the EuroSciPy sprint☆14May 21, 2023Updated 2 years ago
- GPU programming related news and material links☆2,010Sep 17, 2025Updated 5 months ago
- A playbook for starting a commercial open source business☆19Sep 27, 2024Updated last year
- LLM training parallelisms (DP, FSDP, TP, PP) in pure C☆26Jan 27, 2026Updated last month
- Code for my workshop "Production-ready WebAssembly with Rust" presented at RustLab 2023 in Florence☆15Nov 23, 2023Updated 2 years ago
- High Performance FP8 GEMM Kernels for SM89 and later GPUs.☆20Jan 24, 2025Updated last year
- Ship correct and fast LLM kernels to PyTorch☆144Jan 14, 2026Updated last month
- Using multiple LLMs for ensemble Forecasting☆16Jan 17, 2024Updated 2 years ago
- Quantized LLM training in pure CUDA/C++.☆241Feb 22, 2026Updated last week
- Pure Triton kernels for Qwen3.5-27B inference on NVIDIA B200☆66Updated this week
- ☆19Dec 31, 2025Updated 2 months ago
- A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.☆595Aug 12, 2025Updated 6 months ago
- ☆20Jul 12, 2023Updated 2 years ago
- ☆20Nov 23, 2022Updated 3 years ago
- Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training☆132Apr 17, 2024Updated last year
- Puzzles for learning Triton☆2,324Nov 18, 2024Updated last year
- ☆22Apr 22, 2024Updated last year
- Read and write tensorboard data using Rust☆24Feb 4, 2024Updated 2 years ago
- Vocabulary Parallelism☆25Mar 10, 2025Updated 11 months ago
- Explore training for quantized models☆26Jul 12, 2025Updated 7 months ago
- Slides, notes, and materials for the workshop☆339Jun 1, 2024Updated last year