JetSpec: Breaking the Scaling Ceiling of Speculative Decoding with Causal Parallel Tree Drafting
☆161Jun 27, 2026Updated 2 weeks ago
Alternatives and similar repositories for JetSpec
Users that are interested in JetSpec are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official implementation of “Domino: Decoupling Causal Modeling from Autoregressive Drafting in Speculative Decoding”.☆118Jun 24, 2026Updated 2 weeks ago
- DeepSpec: a full-stack codebase for training and evaluating speculative decoding algorithms☆6,638Updated this week
- ☆389Apr 16, 2026Updated 2 months ago
- [NeurIPS 2025] Scaling Speculative Decoding with Lookahead Reasoning☆70Oct 31, 2025Updated 8 months ago
- Scale digital agent rollouts without pain.☆33Jun 18, 2026Updated 3 weeks ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- DFlash: Block Diffusion for Flash Speculative Decoding☆5,468May 10, 2026Updated 2 months ago
- FlashMemory DS-V4 Retriever: a lightweight retriever that sparsifies DeepSeek-V4 CSA KV-cache. Weights available on Hugging Face.☆89Updated this week
- NVFP4 Flash-Attention 4 on BlackWell☆24Jul 7, 2026Updated last week
- Multi-Turn RL Training System with AgentTrainer for Language Model Game Reinforcement Learning☆65Dec 18, 2025Updated 6 months ago
- [ICML 2026] d3LLM: Ultra-Fast Diffusion LLM 🚀☆147May 1, 2026Updated 2 months ago
- ☆20Dec 24, 2024Updated last year
- Official Implementation of SAM-Decoding: Speculative Decoding via Suffix Automaton☆52May 12, 2026Updated 2 months ago
- high-performance linear attention kernel library built on TileLang☆590Updated this week
- Compact and Agent-Native MoE Training System☆253Updated this week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Memory-bounded compressed sparse attention via streaming top-k. Triton kernels for the DeepSeek-V4 lightning indexer. 32x regime extensio…☆22May 5, 2026Updated 2 months ago
- The official repo of VideoAgentTrek☆55Oct 24, 2025Updated 8 months ago
- [NeurIPS 2025] Simple extension on vLLM to help you speed up reasoning model without training.☆231May 31, 2025Updated last year
- TokenSpeed is a speed-of-light LLM inference engine.☆1,589Updated this week
- ☆40Jul 1, 2026Updated last week
- [ASPLOS'26] Taming the Long-Tail: Efficient Reasoning RL Training with Adaptive Drafter☆173Feb 27, 2026Updated 4 months ago
- Official repository for Parallax (Parameterized Local Linear Attention)☆63Jul 7, 2026Updated last week
- Efficient Long-context Language Model Training by Core Attention Disaggregation☆106Apr 7, 2026Updated 3 months ago
- CODA: Rewriting Transformer Blocks as GEMM-Epilogue Programs☆227Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆52May 19, 2025Updated last year
- We release Open Meditron, a fully open, clinician-audited medical training corpus and evaluation protocol that closes the open-vs-closed …☆15May 15, 2026Updated last month
- FlexAttention w/ FlashAttention3 Support☆27Oct 5, 2024Updated last year
- ☆37Aug 7, 2025Updated 11 months ago
- An experimental communicating attention kernel based on DeepEP.☆34Jul 29, 2025Updated 11 months ago
- Official Implementation of LANTERN (ICLR'25) and LANTERN++(ICLRW-SCOPE'25)☆21Mar 5, 2025Updated last year
- ☆20May 30, 2026Updated last month
- Official repository Flash Local Linear Attention☆37May 28, 2026Updated last month
- ☆293Jul 7, 2026Updated last week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆135May 29, 2025Updated last year
- [NeurIPS 2024] Efficient LLM Scheduling by Learning to Rank☆81Nov 4, 2024Updated last year
- FlashKDA: high-performance Kimi Delta Attention kernels☆450May 26, 2026Updated last month
- IndexCache: Accelerating Sparse Attention via Cross-Layer Index Reuse☆124Mar 14, 2026Updated 4 months ago
- Train speculative decoding models effortlessly and port them smoothly to SGLang serving.☆987Updated this week
- Winner 🏆 (Agent-only) MLSys 2026 - FlashInfer AI Kernel Generation Contest for the DeepSeek Sparse Attention (DSA) track with an average…☆148Jun 10, 2026Updated last month
- vLLM Qwen 3.6-27B (AWQ-INT4) + DFlash speculative decoding on AMD Strix Halo (gfx1151 iGPU, 128 GB UMA, ROCm 7.13). 24.8 t/s single-strea…☆46May 10, 2026Updated 2 months ago