Official Implementation of DART (DART: Low-Latency Parallel Drafting with Continuity-Aware Tree Pruning for Speculative Decoding, EMNLP26).
☆72Nov 2, 2026Updated this week
Alternatives and similar repositories for DART
Users that are interested in DART are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- PARD: Accelerating LLM Inference with Low-Cost PARallel Draft Model Adaptation (ICLR 26)☆37Jun 10, 2026Updated 4 months ago
- [EMNLP2026 Main] Official implementation of “Domino: Decoupling Causal Modeling from Autoregressive Drafting in Speculative Decoding”.☆141Jul 25, 2026Updated 3 months ago
- Nano vLLM☆15Jun 1, 2026Updated 5 months ago
- Repository for the COLM 2025 paper SpecDec++: Boosting Speculative Decoding via Adaptive Candidate Lengths☆19Jul 10, 2025Updated last year
- Train speculative decoding models effortlessly and port them smoothly to SGLang serving.☆1,271Updated this week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Flexible and Pluggable Serving Engine for Diffusion LLMs☆158Jul 13, 2026Updated 3 months ago
- Draft-Target Disaggregation LLM Serving System via Parallel Speculative Decoding.☆225Mar 18, 2026Updated 7 months ago
- Advancing Block Diffusion Language Models for Test-Time Scaling☆16Feb 14, 2026Updated 8 months ago
- This repository contains the code for the ICLR 2026 paper “DASH: Deterministic Attention Scheduling for High-Throughput Reproducible LLM …☆15Jun 23, 2026Updated 4 months ago
- [ICML 2026] Official implementation of "FOCUS: DLLMs Know How to Tame Their Compute Bound".☆19Aug 2, 2026Updated 3 months ago
- [ICLR 2026] dParallel: Learnable Parallel Decoding for dLLMs☆68Apr 12, 2026Updated 6 months ago
- EMNLP 2025☆14Nov 28, 2024Updated last year
- Official implementation of "Learning To Draft: Adaptive Speculative Decoding with Reinforcement Learning" (ICLR 2026)☆24Mar 1, 2026Updated 8 months ago
- 📰 Must-read papers and blogs on Speculative Decoding ⚡️☆1,305Jun 27, 2026Updated 4 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- [EuroSys27] TokenCake: A KV-Cache-centric Serving Framework for LLM-based Multi-Agent Applications☆15Updated this week
- Small implementation of the paper TiDAR: Think in Diffusion, Talk in Autoregression☆22Dec 26, 2025Updated 10 months ago
- This is the code for “SMOG: Accelerating Subgraph Matching on GPUs”, which won the GraphChallenge 2023 champion.☆11Oct 16, 2023Updated 3 years ago
- ☆16Jun 17, 2026Updated 4 months ago
- ☆12Jun 6, 2026Updated 5 months ago
- Official Implementation of EAGLE-1 (ICML'24), EAGLE-2 (EMNLP'24), and EAGLE-3 (NeurIPS'25).☆2,572Feb 20, 2026Updated 8 months ago
- ☆16Jul 1, 2026Updated 4 months ago
- DFlash: Block Diffusion for Flash Speculative Decoding☆6,218Aug 18, 2026Updated 2 months ago
- SpecOPD: Branch-parallel on-policy distillation for faster speculative decoding.☆25Updated this week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Adamas: Hadamard Sparse Attention for Efficient Long-context Inference☆15Updated this week
- Unofficial Evaluation for LLaDA2.0-mini-preview with LM-eval☆11Nov 24, 2025Updated 11 months ago
- high-performance linear attention kernel library built on TileLang☆749Oct 30, 2026Updated last week
- [ICML 2026] d3LLM: Ultra-Fast Diffusion LLM 🚀☆157May 1, 2026Updated 6 months ago
- Spec-Bench: A Comprehensive Benchmark and Unified Evaluation Platform for Speculative Decoding (ACL 2024 Findings)☆414Apr 22, 2025Updated last year
- LightningRL: Breaking the Accuracy–Parallelism Trade-off of Block-wise dLLMs via Reinforcement Learning☆33Apr 25, 2026Updated 6 months ago
- A unified workflow orchestration and distributed KV cache sharing framework for multimodal inference.☆38Sep 4, 2026Updated 2 months ago
- [ASPLOS'26] Taming the Long-Tail: Efficient Reasoning RL Training with Adaptive Drafter☆187Feb 27, 2026Updated 8 months ago
- The high-performance distributed tensor layer — load once, share everywhere.☆54Sep 17, 2026Updated last month
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆15May 6, 2026Updated 6 months ago
- [ ICCV'2025 Poster ] SecDOOD is a secure cloud-device collaboration framework for efficient on-device OOD detection without requiring de…☆15Oct 10, 2025Updated last year
- [ICLR 2026] Official PyTorch implementation for "ReFusion: A Diffusion Large Language Model with Parallel Autoregressive Decoding"☆64Dec 26, 2025Updated 10 months ago
- [ACL 26 Findings] LogitSpec: Accelerating Retrieval-based Speculative Decoding via Next Next Token Speculation☆13Apr 21, 2026Updated 6 months ago
- 根据单词列表生成单词发音mp3☆11Feb 18, 2021Updated 5 years ago
- [EMNLP 2026 (Oral)] Multi-Block Diffusion Language Models☆27Jul 4, 2026Updated 4 months ago
- Official Implementation of MARS☆28Apr 21, 2026Updated 6 months ago