LLM Inference via Triton (Flexible & Modular): Focused on Kernel Optimization using CUBIN binaries, Starting from gpt-oss Model
☆115Apr 28, 2026Updated 3 weeks ago
Alternatives and similar repositories for tritonllm
Users that are interested in tritonllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- triton for dsa☆63May 12, 2026Updated last week
- Take your first step in writing a compiler. Implemented in Rust.☆16Apr 17, 2023Updated 3 years ago
- FlagTree is a unified compiler supporting multiple AI chip backends for custom Deep Learning operations, which is forked from triton-lang…☆264May 16, 2026Updated last week
- JAX bindings for the flash-attention3 kernels☆22Jan 2, 2026Updated 4 months ago
- ☆36Mar 7, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆151Mar 5, 2026Updated 2 months ago
- A simple gitlab/github web hooks daemon☆16May 15, 2026Updated last week
- Hands-On Practical MLIR Tutorial☆772Oct 20, 2023Updated 2 years ago
- AMD RAD's multi-GPU Triton-based framework for seamless multi-GPU programming☆188Updated this week
- APAR: LLMs Can Do Auto-Parallel Auto-Regressive Decoding☆14Jul 22, 2024Updated last year
- ☆13Apr 12, 2026Updated last month
- Tile-based language built for AI computation across all scales☆153Updated this week
- Official Pytorch implementation of "Omni-AVSR: Towards Unified Multimodal Speech Recognition with Large Language Models" [IEEE ICASSP 202…☆37Mar 10, 2026Updated 2 months ago
- GEMV implementation with CUTLASS☆21Aug 21, 2025Updated 9 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- PyTorch unoffical implementation of "PoE-GAN : Multimodal Conditional Image Synthesis with Product-of-Experts GANs"☆15Mar 29, 2023Updated 3 years ago
- High performance RMSNorm Implement by using SM Core Storage(Registers and Shared Memory)☆30Jan 22, 2026Updated 4 months ago
- Collection of kernels written in Triton language☆194Jan 27, 2026Updated 3 months ago
- ☆11Mar 3, 2026Updated 2 months ago
- incubator repo for CUDA-TileIR backend☆135Apr 22, 2026Updated last month
- ☆33Mar 31, 2026Updated last month
- ☆32Jul 2, 2025Updated 10 months ago
- PyTorch distributed training acceleration framework☆55Aug 13, 2025Updated 9 months ago
- Nex Venus Communication Library☆75Nov 17, 2025Updated 6 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- PTX-EMU is a simple emulator for CUDA program.☆38Apr 25, 2025Updated last year
- Distributed Compiler based on Triton for Parallel Systems☆1,426Apr 22, 2026Updated last month
- ☆37Aug 7, 2025Updated 9 months ago
- ☆31Jan 7, 2025Updated last year
- ☆21Nov 3, 2025Updated 6 months ago
- 图书《深入理解LLVM代码生成》的配套示例代码☆40Sep 9, 2024Updated last year
- TinyML and Efficient Deep Learning Computing☆20Apr 26, 2024Updated 2 years ago
- Optimize tensor program fast with Felix, a gradient descent autotuner.☆33Mar 5, 2026Updated 2 months ago
- cutile kernel examples☆49Apr 3, 2026Updated last month
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- 一个开源数学大模型项目，旨在探索大模型是否具有数学创造能力，以及大模型在前沿数学研究中的潜在能力。☆18Mar 19, 2026Updated 2 months ago
- ☆115Apr 23, 2026Updated last month
- Exploring how optimizations for GEMMs work☆33Feb 28, 2026Updated 2 months ago
- High performance inference engine for diffusion models☆108Sep 5, 2025Updated 8 months ago
- A Wordle game written in Rust, refined. Play in browser with the power of WebAssembly! Course project of Programming Training, Tsinghua U…☆16Jul 10, 2024Updated last year
- Extensive Self-Contrast Enables Feedback-Free Language Model Alignment☆20Apr 2, 2024Updated 2 years ago
- AAAI2025☆13Apr 18, 2025Updated last year