Repository for the COLM 2025 paper SpecDec++: Boosting Speculative Decoding via Adaptive Candidate Lengths
☆19Jul 10, 2025Updated last year
Alternatives and similar repositories for SpecDec_pp
Users that are interested in SpecDec_pp are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Adamas: Hadamard Sparse Attention for Efficient Long-context Inference☆15Oct 1, 2026Updated last week
- Official Implementation of DART (DART: Low-Latency Parallel Drafting with Continuity-Aware Tree Pruning for Speculative Decoding, EMNLP26…☆71Aug 25, 2026Updated last month
- ☆32May 24, 2025Updated last year
- ☆19May 4, 2023Updated 3 years ago
- ☆14May 9, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- [NeurIPS 2021] Source code for the paper "Qu-ANTI-zation: Exploiting Neural Network Quantization for Achieving Adversarial Outcomes"☆18Nov 9, 2021Updated 4 years ago
- Artifact for "Apparate: Rethinking Early Exits to Tame Latency-Throughput Tensions in ML Serving" [SOSP '24]☆25Nov 21, 2024Updated last year
- 这是一个从零学习CUDA课程☆13Nov 3, 2024Updated last year
- Code for the EMNLP24 paper "A simple and effective L2 norm based method for KV Cache compression."☆19Dec 13, 2024Updated last year
- FA4-based Relative Attention Kernel developed by TML and Colfax☆18Sep 11, 2026Updated last month
- ☆11May 13, 2025Updated last year
- [ACL 2025 main] FR-Spec: Frequency-Ranked Speculative Sampling☆56Jul 15, 2025Updated last year
- Princeton University Ph.D. Dissertation Template☆20Apr 9, 2017Updated 9 years ago
- 自然语言处理大作业-三种中文分词方法的性能对比与评分☆22Jan 17, 2021Updated 5 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- NUMA-Aware Reader-Writer Locks☆20Jun 12, 2014Updated 12 years ago
- Feature Extraction Toolbox from CUHKÐZ&SIAT submission to ActivityNet 2016☆32Mar 31, 2019Updated 7 years ago
- [ICLR 2025] PEARL: Parallel Speculative Decoding with Adaptive Draft Length☆172Dec 23, 2025Updated 9 months ago
- ☆51Sep 13, 2025Updated last year
- Check your grade automatically and send e-mail when new grade comes☆12Feb 7, 2018Updated 8 years ago
- ☆69Nov 4, 2024Updated last year
- The Official Implementation of Ada-KV [NeurIPS 2025]☆141Nov 26, 2025Updated 10 months ago
- Code repository for the SOSP'25 paper DCP: Addressing Input Dynamism In Long-Context Training via Dynamic Context Parallelism.☆23Nov 28, 2025Updated 10 months ago
- Agent application/benchmark/workload traces should be placed here.☆17Apr 13, 2026Updated 6 months ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Path to a qualified quant developer in 104 weeks, just for fun LOL🤣.☆26Jun 21, 2026Updated 3 months ago
- A fast and scalable distributed lock service using programmable switches.☆21Jul 30, 2024Updated 2 years ago
- 📰 Must-read papers and blogs on Speculative Decoding ⚡️☆1,298Jun 27, 2026Updated 3 months ago
- Draft-Target Disaggregation LLM Serving System via Parallel Speculative Decoding.☆223Mar 18, 2026Updated 6 months ago
- Source code of IPA, https://escholarship.org/uc/item/2p0805dq☆13Jun 27, 2024Updated 2 years ago
- Official implementation of the paper "Pretraining Language Models to Ponder in Continuous Space"☆27Jul 21, 2025Updated last year
- Code for the paper "Robustness Certificates for Sparse Adversarial Attacks by Randomized Ablation" by Alexander Levine and Soheil Feizi.☆10Aug 22, 2022Updated 4 years ago
- [CVPR'25] Conformal prediction for vision-language models. Enhancing VLMs deployment with reliability gurarantees.☆21Jun 7, 2025Updated last year
- [ICLR 2025] TidalDecode: A Fast and Accurate LLM Decoding with Position Persistent Sparse Attention☆57Aug 6, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- [ICLR2025 Spotlight] MagicPIG: LSH Sampling for Efficient LLM Generation☆257Dec 16, 2024Updated last year
- A method for training neural networks that are provably robust to adversarial attacks. [IJCAI 2019]☆10Sep 3, 2019Updated 7 years ago
- REST: Retrieval-Based Speculative Decoding, NAACL 2024☆220Mar 5, 2026Updated 7 months ago
- KV Cache Compression, But What Must We Give in Return? A Comprehensive Benchmark of Long Context Capable Approaches. EMNLP Findings 2024☆90Feb 27, 2025Updated last year
- ☆20Feb 5, 2026Updated 8 months ago
- [EMNLP2026 Main] Official implementation of “Domino: Decoupling Causal Modeling from Autoregressive Drafting in Speculative Decoding”.☆139Jul 25, 2026Updated 2 months ago
- 项目的主仓库☆27Sep 11, 2022Updated 4 years ago