☆16Aug 19, 2024Updated 2 years ago
Alternatives and similar repositories for decoding-speculative-decoding
Users that are interested in decoding-speculative-decoding are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆32May 24, 2025Updated last year
- DuoDecoding: Hardware-aware Heterogeneous Speculative Decoding with Dynamic Multi-Sequence Drafting☆19Mar 4, 2025Updated last year
- ☆15Apr 6, 2026Updated 6 months ago
- ☆11Feb 5, 2026Updated 8 months ago
- ☆28Mar 14, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆19Sep 10, 2026Updated last month
- Multi-Candidate Speculative Decoding☆40Apr 22, 2024Updated 2 years ago
- Distributed Quantum compiler codebase☆14Updated this week
- EAQuant: Enhancing Post-Training Quantization for MoE Models via Expert-Aware Optimization☆15Feb 6, 2026Updated 8 months ago
- QA and summarization over long-context documents☆12Mar 16, 2025Updated last year
- Thesis project about Visual Anomaly Detection based on Self Supervised Learning. The model identifies anomalies from information acquired…☆11Apr 14, 2023Updated 3 years ago
- This repository contains the codebase for the paper Route to Reason: Adaptive Routing for LLM and Reasoning Strategy Selection☆10Jun 30, 2025Updated last year
- (CVPR'26) Gradient-free Layer Selection for Efficient Training of Deep Neural Networks☆12Mar 23, 2026Updated 7 months ago
- Code repo for efficient quantized MoE inference with mixture of low-rank compensators☆39Apr 14, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Fast inference from large lauguage models via speculative decoding☆927Aug 22, 2024Updated 2 years ago
- T5 model optimized with FlexAttention☆14Sep 30, 2024Updated 2 years ago
- 一个小游戏☆14Aug 17, 2022Updated 4 years ago
- A Overview of Efficiently Serving Foundation Models across Edge Devices☆15Jan 17, 2025Updated last year
- [ACCV 2026] FFNet: MetaMixer-based Efficient Convolutional Mixer Design☆34Mar 11, 2025Updated last year
- A Low-level first-order probabilistic programming language, with in built translation constraints for automatic model checking. A flexibl…☆14Apr 16, 2019Updated 7 years ago
- A demo of the Mito Streamlit Spreadsheet☆18Aug 3, 2023Updated 3 years ago
- GitHub Repository for KDD 2022 paper "Saliency-Regularized Deep Multi-Task Learning"☆12Sep 26, 2023Updated 3 years ago
- Repo for "STAR: Spectral Truncation and Rescale for Model Merging" [NAACL 2025]☆11Oct 22, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- GPU operators for sparse tensor operations☆37Mar 11, 2024Updated 2 years ago
- Scaling to Tens of Thousands of Test-Time Iterations with Loop-Native Attention Residuals☆12Oct 21, 2026Updated last week
- Easy-to-use Retrieval-Enhanced Transformer implementation☆10Sep 30, 2022Updated 4 years ago
- [EMNLP 2024 (main)] Attention Score is not All You Need for Token Importance Indicator in KV Cache Reduction: Value Also Matters☆14Nov 5, 2024Updated last year
- ☆14Aug 3, 2024Updated 2 years ago
- ☆11Mar 4, 2025Updated last year
- This is the code repository of paper "SFT Conflicts, RL Coexists"☆52Aug 4, 2026Updated 2 months ago
- ☆13Jan 22, 2025Updated last year
- ICML2019 Accepted Paper. Overcoming Multi-Model Forgetting☆14Jun 5, 2019Updated 7 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Large-scale Exploration of Neural Relation Classification Architectures☆11Nov 15, 2018Updated 7 years ago
- Easy recipes to speed up latency of Flux, QwenImage, and LTX-2 with NVFP4 and MXFP8 on Blackwell.☆14Apr 10, 2026Updated 6 months ago
- Ubuntu 23.10 and 22.04 for Android Termux, No root required☆12Sep 3, 2024Updated 2 years ago
- Official code for "There is no SAMantics! Exploring SAM as a Backbone for Visual Understanding Tasks"☆11Jul 5, 2025Updated last year
- 해커그라운드 해커톤 2024☆12Aug 26, 2024Updated 2 years ago
- Implementation of the paper Fast Inference from Transformers via Speculative Decoding, Leviathan et al. 2023.☆116Dec 2, 2024Updated last year
- ☆10Jun 19, 2025Updated last year