tile-ai / TileRTLinks
Tile-Based Runtime for Ultra-Low-Latency LLM Inference
☆178Updated this week
Alternatives and similar repositories for TileRT
Users that are interested in TileRT are comparing it to the libraries listed below
Sorting:
- DeeperGEMM: crazy optimized version☆73Updated 6 months ago
- Multi-Level Triton Runner supporting Python, IR, PTX, and cubin.☆76Updated last week
- [NeurIPS 2025] ClusterFusion: Expanding Operator Fusion Scope for LLM Inference via Cluster-Level Collective Primitive☆49Updated last month
- ☆65Updated 6 months ago
- Tile-based language built for AI computation across all scales☆80Updated last week
- [HPCA 2025] A GPU-optimized system for efficient long-context LLMs decoding with low-bit KV cache.☆62Updated last week
- NVSHMEM‑Tutorial: Build a DeepEP‑like GPU Buffer☆143Updated 2 months ago
- SpInfer: Leveraging Low-Level Sparsity for Efficient Large Language Model Inference on GPUs☆59Updated 7 months ago
- Building the Virtuous Cycle for AI-driven LLM Systems☆91Updated this week
- Sequence-level 1F1B schedule for LLMs.☆37Updated 2 months ago
- A lightweight design for computation-communication overlap.☆187Updated last month
- ☆33Updated last month
- Implement Flash Attention using Cute.☆96Updated 11 months ago
- Distributed MoE in a Single Kernel [NeurIPS '25]☆125Updated last month
- An experimental communicating attention kernel based on DeepEP.☆34Updated 3 months ago
- TritonBench: Benchmarking Large Language Model Capabilities for Generating Triton Operators☆95Updated 5 months ago
- gLLM: Global Balanced Pipeline Parallelism System for Distributed LLM Serving with Token Throttling☆49Updated this week
- DLSlime: Flexible & Efficient Heterogeneous Transfer Toolkit☆82Updated this week
- ☆31Updated 4 months ago
- a simple API to use CUPTI☆11Updated 3 months ago
- ☆39Updated 3 months ago
- ☆50Updated 6 months ago
- ☆102Updated last year
- ☆159Updated last year
- ☆121Updated 3 months ago
- ArkVale: Efficient Generative LLM Inference with Recallable Key-Value Eviction (NIPS'24)☆44Updated 11 months ago
- Github mirror of trition-lang/triton repo.☆98Updated this week
- ☆58Updated last year
- [DAC'25] Official implement of "HybriMoE: Hybrid CPU-GPU Scheduling and Cache Management for Efficient MoE Inference"☆89Updated 5 months ago
- ☆38Updated 4 months ago