LLM Inference via Triton (Flexible & Modular): Focused on Kernel Optimization using CUBIN binaries, Starting from gpt-oss Model
☆118Apr 28, 2026Updated 2 months ago
Alternatives and similar repositories for tritonllm
Users that are interested in tritonllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Take your first step in writing a compiler. Implemented in Rust.☆17Apr 17, 2023Updated 3 years ago
- FlagTree is a unified compiler supporting multiple AI chip backends for custom Deep Learning operations, which is forked from triton-lang…☆290Updated this week
- JAX bindings for the flash-attention3 kernels☆24Jan 2, 2026Updated 6 months ago
- ☆37Mar 7, 2025Updated last year
- ☆157Mar 5, 2026Updated 3 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Hands-On Practical MLIR Tutorial☆801Oct 20, 2023Updated 2 years ago
- AMD RAD's multi-GPU Triton-based framework for seamless multi-GPU programming☆191Jun 24, 2026Updated last week
- 结构化的《老友记》剧本S1-S10☆22Jun 24, 2019Updated 7 years ago
- ☆14Apr 28, 2026Updated 2 months ago
- Tile-based language built for AI computation across all scales☆170Jun 16, 2026Updated 2 weeks ago
- GEMV implementation with CUTLASS☆21Aug 21, 2025Updated 10 months ago
- Getting Started with Triton: A Tutorial for Python Beginners☆60Mar 26, 2026Updated 3 months ago
- High performance RMSNorm Implement by using SM Core Storage(Registers and Shared Memory)☆30Jan 22, 2026Updated 5 months ago
- Collection of kernels written in Triton language☆199Jan 27, 2026Updated 5 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Multi-Level Triton Runner supporting Python, IR, PTX, AMDGCN, cubin and hasco.☆98May 8, 2026Updated last month
- incubator repo for CUDA-TileIR backend☆144Jun 16, 2026Updated 2 weeks ago
- PyTorch distributed training acceleration framework☆56Aug 13, 2025Updated 10 months ago
- Nex Venus Communication Library☆75Nov 17, 2025Updated 7 months ago
- PTX-EMU is a simple emulator for CUDA program.☆40Apr 25, 2025Updated last year
- Custom kernels in Triton language for accelerating LLMs☆27Apr 5, 2024Updated 2 years ago
- A container supporting the compilers course on edX for building a Cool compiler☆12Jan 9, 2024Updated 2 years ago
- ☆37Aug 7, 2025Updated 10 months ago
- ☆31Jan 7, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- 图书《深入理解LLVM代码生成》的配套示例代码☆40Sep 9, 2024Updated last year
- TinyML and Efficient Deep Learning Computing☆20Apr 26, 2024Updated 2 years ago
- ☆23Jun 25, 2026Updated last week
- cutile kernel examples☆50Apr 3, 2026Updated 2 months ago
- ☆126Apr 23, 2026Updated 2 months ago
- Exploring how optimizations for GEMMs work☆36Feb 28, 2026Updated 4 months ago
- High performance inference engine for diffusion models☆108Sep 5, 2025Updated 9 months ago
- AAAI2025☆13Apr 18, 2025Updated last year
- A dataflow compiler☆31Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- An implementation of a BinaryConnect network for cifar10☆11Nov 4, 2019Updated 6 years ago
- A Triton-only attention backend for vLLM☆27Mar 17, 2026Updated 3 months ago
- Empowering LLM Agents for Real-World Computer System Optimization☆18Sep 10, 2025Updated 9 months ago
- Github repo for ICLR-2025 paper, Fine-tuning Large Language Models with Sparse Matrices☆26Feb 2, 2026Updated 5 months ago
- An MLIR-based compiler from C/C++ to AMD-Xilinx Versal AIE☆17Aug 5, 2022Updated 3 years ago
- USTC计算物理A☆10Aug 16, 2021Updated 4 years ago
- KsanaDiT: High-Performance DiT (Diffusion Transformer) Inference Framework for Video & Image Generation☆60May 13, 2026Updated last month