Repository for the COLM 2025 paper SpecDec++: Boosting Speculative Decoding via Adaptive Candidate Lengths
☆19Jul 10, 2025Updated last year
Alternatives and similar repositories for SpecDec_pp
Users that are interested in SpecDec_pp are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆12Jun 6, 2026Updated 4 months ago
- (COLING2025) SEED: Accelerating Reasoning Tree Construction via Scheduled Speculative Decoding☆10Dec 18, 2024Updated last year
- EMNLP 2025☆14Nov 28, 2024Updated last year
- Adamas: Hadamard Sparse Attention for Efficient Long-context Inference☆15Oct 1, 2026Updated last month
- Official Implementation of DART (DART: Low-Latency Parallel Drafting with Continuity-Aware Tree Pruning for Speculative Decoding, EMNLP26…☆72Aug 25, 2026Updated 2 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Artifacts for SWARM: Replicating Shared Disaggregated-Memory Data in No Time☆10Sep 25, 2024Updated 2 years ago
- Numerical Experiments☆15Jan 21, 2018Updated 8 years ago
- A repository with academic works about Kernel generation with LLM Agent☆24Updated this week
- ☆32May 24, 2025Updated last year
- ☆19May 4, 2023Updated 3 years ago
- ☆69Dec 3, 2024Updated last year
- The repository for the 2024 IEEE Cloud Submission of OS4C☆10Oct 22, 2026Updated last week
- 这是一个从零学习CUDA课程☆13Nov 3, 2024Updated 2 years ago
- FA4-based Relative Attention Kernel developed by TML and Colfax☆18Sep 11, 2026Updated last month
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Artifact for "Apparate: Rethinking Early Exits to Tame Latency-Throughput Tensions in ML Serving" [SOSP '24]☆25Nov 21, 2024Updated last year
- ☆14May 9, 2024Updated 2 years ago
- Code for the EMNLP24 paper "A simple and effective L2 norm based method for KV Cache compression."☆19Dec 13, 2024Updated last year
- Official Implementation of "Learning Harmonized Representations for Speculative Sampling" (HASS)☆56Mar 14, 2025Updated last year
- [OSDI'25] QiMeng-Xpiler: Transcompiling Tensor Programs for Deep Learning Systems with a Neural-Symbolic Approach☆10Jun 20, 2025Updated last year
- Seminar on Selected Tools☆24May 20, 2018Updated 8 years ago
- [ACL 2025 main] FR-Spec: Frequency-Ranked Speculative Sampling☆56Jul 15, 2025Updated last year
- Feature Extraction Toolbox from CUHKÐZ&SIAT submission to ActivityNet 2016☆32Mar 31, 2019Updated 7 years ago
- ☆22Apr 17, 2026Updated 6 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆11May 13, 2025Updated last year
- ☆15Jan 14, 2026Updated 9 months ago
- A universal workflow system for exactly-once DAGs☆23Jun 1, 2023Updated 3 years ago
- [ICLR 2025] PEARL: Parallel Speculative Decoding with Adaptive Draft Length☆173Dec 23, 2025Updated 10 months ago
- ArkVale: Efficient Generative LLM Inference with Recallable Key-Value Eviction (NIPS'24)☆54Dec 17, 2024Updated last year
- ☆14Mar 20, 2026Updated 7 months ago
- ☆52Sep 13, 2025Updated last year
- [NSDI'26] PolyRL is a reinforcement learning framework for LLM that harvest spot instances on the cloud to reduce cost.☆19Mar 30, 2026Updated 7 months ago
- [COLM 2024] TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding☆280Aug 31, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆14Jan 28, 2024Updated 2 years ago
- [NeurIPS'25 Spotlight] Adaptive Attention Sparsity with Hierarchical Top-p Pruning☆110Aug 31, 2026Updated 2 months ago
- Make FP4 on 5090 Great Again☆24Jul 20, 2026Updated 3 months ago
- NUMA-Aware Reader-Writer Locks☆20Jun 12, 2014Updated 12 years ago
- LUCID: Attention with Preconditioned Representations - A novel attention mechanism for improved long-context retrieval in Transformers☆13May 29, 2026Updated 5 months ago
- The Official Implementation of Ada-KV [NeurIPS 2025]☆143Nov 26, 2025Updated 11 months ago
- This repository contains the codebase for the paper Route to Reason: Adaptive Routing for LLM and Reasoning Strategy Selection☆10Jun 30, 2025Updated last year