☆16Aug 19, 2024Updated 2 years ago
Alternatives and similar repositories for decoding-speculative-decoding
Users that are interested in decoding-speculative-decoding are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆33May 24, 2025Updated last year
- DuoDecoding: Hardware-aware Heterogeneous Speculative Decoding with Dynamic Multi-Sequence Drafting☆20Mar 4, 2025Updated last year
- ☆15Apr 6, 2026Updated 7 months ago
- ☆11Feb 5, 2026Updated 9 months ago
- ☆28Mar 14, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Multi-Candidate Speculative Decoding☆41Apr 22, 2024Updated 2 years ago
- Pytorch Implementation of the Model from "MIRASOL3B: A MULTIMODAL AUTOREGRESSIVE MODEL FOR TIME-ALIGNED AND CONTEXTUAL MODALITIES"☆26Jan 27, 2025Updated last year
- [CVPR 2026] TransPrune: Token Transition Pruning for Efficient Large Vision-Language Model☆22Feb 23, 2026Updated 8 months ago
- Code repo for efficient quantized MoE inference with mixture of low-rank compensators☆39Apr 14, 2025Updated last year
- ☆10Sep 8, 2023Updated 3 years ago
- Fast inference from large lauguage models via speculative decoding☆925Aug 22, 2024Updated 2 years ago
- [ACCV 2026] FFNet: MetaMixer-based Efficient Convolutional Mixer Design☆35Mar 11, 2025Updated last year
- A demo of the Mito Streamlit Spreadsheet☆18Aug 3, 2023Updated 3 years ago
- Accepted by NAACL 2025 main conference.☆11Jan 24, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- [EMNLP 2024 (main)] Attention Score is not All You Need for Token Importance Indicator in KV Cache Reduction: Value Also Matters☆14Nov 5, 2024Updated 2 years ago
- Repo for "STAR: Spectral Truncation and Rescale for Model Merging" [NAACL 2025]☆11Oct 22, 2026Updated 3 weeks ago
- GPU operators for sparse tensor operations☆37Mar 11, 2024Updated 2 years ago
- This repository contains the codebase for the paper Route to Reason: Adaptive Routing for LLM and Reasoning Strategy Selection☆11Jun 30, 2025Updated last year
- Thesis project about Visual Anomaly Detection based on Self Supervised Learning. The model identifies anomalies from information acquired…☆11Apr 14, 2023Updated 3 years ago
- (CVPR'26) Gradient-free Layer Selection for Efficient Training of Deep Neural Networks☆12Mar 23, 2026Updated 7 months ago
- Cluster doctor skills☆14May 23, 2026Updated 5 months ago
- ☆11Apr 5, 2023Updated 3 years ago
- [EMNLP2024] Rethinking Token Reduction for State Space Models☆11Dec 7, 2024Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- tensorflow fork with Salus integration☆12Jan 7, 2022Updated 4 years ago
- This is a preprocessor/data-cleaner for the WebNLG dataset.☆10Oct 17, 2023Updated 3 years ago
- ☆14Mar 30, 2026Updated 7 months ago
- ☆13Jan 22, 2025Updated last year
- [ECCV 2026] Implementation of "CUST : Clustered Unit-level Similarity Transformer for Lightweight Image Super-Resolution"☆12Aug 7, 2026Updated 3 months ago
- demonstration for our ACL 2018 paper, "On the Practical Computational Power of Finite Precision RNNs for Language Recognition"☆11May 26, 2019Updated 7 years ago
- UW-Madison Course Monitor☆10Oct 4, 2019Updated 7 years ago
- Various TeX templates, including slides and posters.☆16May 19, 2022Updated 4 years ago
- EntroPIC: Towards Stable Long-Term Training of LLMs via Entropy Stabilization with Proportional-Integral Control☆13Feb 3, 2026Updated 9 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆16Dec 9, 2023Updated 2 years ago
- Code of "Regularized Best-of-N Sampling with Minimum Bayes Risk Objective for Language Model Alignment" (2025).☆14Apr 4, 2025Updated last year
- ☆11Mar 4, 2025Updated last year
- ☆13Apr 21, 2026Updated 6 months ago
- This repository contains code for the paper "Layer by Layer: Uncovering Where Multi-Task Learning Happens in Instruction-Tuned Large Lang…☆10Nov 12, 2024Updated 2 years ago
- Code for reproducing experiments performed for Accoridon☆13Jun 11, 2021Updated 5 years ago
- ☆13Updated this week
Are these results useful?