Code for the paper *Attention Drift: What Speculative Decoding Models Learn*.
☆33May 12, 2026Updated 6 months ago
Alternatives and similar repositories for Attention-Drift
Users that are interested in Attention-Drift are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The official repo of "Draft-OPD: On-Policy Distillation for Speculative Draft Models"☆84Sep 4, 2026Updated 2 months ago
- ☆22Apr 17, 2026Updated 6 months ago
- ☆16Jul 21, 2026Updated 3 months ago
- Distil SN97 — Competitive Model Distillation on Bittensor☆35May 20, 2026Updated 5 months ago
- A PyTorch native library for training speculative decoding models☆267Updated this week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Make FP4 on 5090 Great Again☆24Jul 20, 2026Updated 3 months ago
- ☆17Oct 20, 2026Updated 3 weeks ago
- A repository for pretraining a discrete diffusion model (llada), with all components built on the Hugging Face ecosystem.☆13Aug 27, 2025Updated last year
- ☆11Aug 26, 2024Updated 2 years ago
- [ACL-main-2026]We introduce Chart2Code, the first user-driven, hierarchical benchmark that systematically evaluates Large Multimodal Mode…☆31Sep 30, 2026Updated last month
- Reading notes on Speculative Decoding papers☆49Jun 2, 2026Updated 5 months ago
- LLM inference in C/C++☆24Oct 21, 2026Updated 3 weeks ago
- PARD: Accelerating LLM Inference with Low-Cost PARallel Draft Model Adaptation (ICLR 26)☆37Jun 10, 2026Updated 5 months ago
- ☆22Oct 18, 2026Updated 3 weeks ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- [ICML 2026] Jacobi Forcing: Fast and Accurate Diffusion-style Decoding☆119Feb 20, 2026Updated 8 months ago
- 🔥 [ICML'26] ParisKV: Fast and Drift-Robust KV-Cache Retrieval for Long-Context LLMs☆37Aug 14, 2026Updated 2 months ago
- ORL: On-Policy Residual Learning for Diffusion Language Models☆28Oct 16, 2026Updated 3 weeks ago
- Fingerprint the exact GPU you're running on, even among identical GPUs, from the order its atomic adds land in. 99.1% accuracy, survives …☆30Oct 30, 2026Updated last week
- [IJCV2023] Offical implementation of "SCT: A Simple Baseline for Parameter-Efficient Fine-Tuning via Salient Channels"☆12Sep 18, 2023Updated 3 years ago
- official code for GliDe with a CaPE☆21Aug 13, 2024Updated 2 years ago
- Official repo of paper "Nested Sparsity for Scalable Pretraining and Continual Learning"☆18Nov 4, 2026Updated last week
- 20251101-https://arxiv.org/pdf/2510.21603☆10Nov 3, 2025Updated last year
- Qwen3.5-2B with a SIMT GPU inside its weights, 45 compiled layers in front of Qwen’s own, using its Gated DeltaNet layers as registers an…☆119Nov 1, 2026Updated last week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆14May 4, 2026Updated 6 months ago
- ☆13Nov 3, 2026Updated last week
- Seeing is Not Reasoning: MVPBench for Graph-based Evaluation of Multi-path Visual Physical CoT☆14Jul 30, 2025Updated last year
- [NeurIPS 2026] Free Draft-and-Verification: Toward Lossless Parallel Decoding for Diffusion Large Language Models☆24Sep 29, 2026Updated last month
- Hierarchical Speculative Decoding is the SOTA verification algorithm for lossless accelerated LLM inference.☆25Updated this week
- The official repo of continuous speculative decoding☆36Mar 28, 2025Updated last year
- ☆41Aug 16, 2026Updated 2 months ago
- An extention to the GaLore paper, to perform Natural Gradient Descent in low rank subspace☆19Oct 21, 2024Updated 2 years ago
- ☆19Oct 14, 2026Updated 3 weeks ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Accurate and fast KV cache compression with a gating mechanism☆35Jul 27, 2026Updated 3 months ago
- ☆11Oct 29, 2026Updated 2 weeks ago
- Tiny node module of utilities for working with waveforms in the browser. Depends on pcm.js and ffprobe.js.☆12Apr 22, 2013Updated 13 years ago
- This is the repository for our AgentSearch Benchmark. The official website is https://bingo-w.github.io/AgentSearchBench/☆16Jul 23, 2026Updated 3 months ago
- [ICCV 2025] Rethinking Detecting Salient and Camouflaged Objects in Unconstrained Scenes☆21Nov 9, 2025Updated last year
- ☆12Feb 10, 2025Updated last year
- ☆16May 15, 2025Updated last year
Are these results useful?