3x Faster Inference; Unofficial implementation of EAGLE Speculative Decoding
☆85Jul 3, 2025Updated last year
Alternatives and similar repositories for BaldEagle
Users that are interested in BaldEagle are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official Implementation of "Learning Harmonized Representations for Speculative Sampling" (HASS)☆56Mar 14, 2025Updated last year
- Official Implementation of EAGLE-1 (ICML'24), EAGLE-2 (EMNLP'24), and EAGLE-3 (NeurIPS'25).☆2,567Feb 20, 2026Updated 8 months ago
- Train speculative decoding models effortlessly and port them smoothly to SGLang serving.☆1,252Updated this week
- Official Implementation of SAM-Decoding: Speculative Decoding via Suffix Automaton☆54May 12, 2026Updated 5 months ago
- This repository is the official implementation of "Jakiro: Boosting Speculative Decoding with Decoupled Multi-Head via MoE" [ACL 2026 Mai…☆39Oct 5, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Fast and memory-efficient exact attention☆23Updated this week
- [ACL 2025 main] FR-Spec: Frequency-Ranked Speculative Sampling☆56Jul 15, 2025Updated last year
- An easy-to-use package for implementing SmoothQuant for LLMs☆112Apr 7, 2025Updated last year
- Official Implementation of "GRIFFIN: Effective Token Alignment for Faster Speculative Decoding"[NeurIPS 2025]☆21May 12, 2025Updated last year
- A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM☆933Updated this week
- ScribePal is an Open Source intelligent browser extension that leverages AI to empower your web experience by providing contextual insigh…☆22Updated this week
- Draft-Target Disaggregation LLM Serving System via Parallel Speculative Decoding.☆224Mar 18, 2026Updated 7 months ago
- A PyTorch native library for training speculative decoding models☆266Updated this week
- 🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…☆289Nov 24, 2025Updated 11 months ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- A fast, local, and secure approach for training LLMs for coding tasks using GRPO with WebAssembly and interpreter feedback.☆42Apr 4, 2025Updated last year
- code for https//research.fb.com/publications/towards-automated-neural-interaction-discovery-for-click-through-rate-prediction/☆19Mar 29, 2021Updated 5 years ago
- [ICML 2025] AdaDecode: Accelerating LLM Decoding with Adaptive Layer Parallelism☆20Jul 14, 2025Updated last year
- KV Cache Compression, But What Must We Give in Return? A Comprehensive Benchmark of Long Context Capable Approaches. EMNLP Findings 2024☆90Feb 27, 2025Updated last year
- Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.☆54Oct 29, 2025Updated last year
- Go ahead and axolotl questions☆11Feb 6, 2024Updated 2 years ago
- 📰 Must-read papers and blogs on Speculative Decoding ⚡️☆1,305Jun 27, 2026Updated 4 months ago
- A simple OpenAI TTS compatible voice server based on Pico2Wave☆13Nov 18, 2024Updated last year
- ☆27Mar 1, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- [ICDCS 2023] Evaluation and Optimization of Gradient Compression for Distributed Deep Learning☆10Apr 28, 2023Updated 3 years ago
- Code for "Domain Adaptive Meta-learning for Dialogue State Tracking"(TASLP2021)☆10Sep 14, 2021Updated 5 years ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆11Sep 4, 2025Updated last year
- [ICLR 2025] PEARL: Parallel Speculative Decoding with Adaptive Draft Length☆173Dec 23, 2025Updated 10 months ago
- Official implementation for "MarketSim: Simulating Stock Markets with Large-Scale Generative Agents (ICML'2026)"☆13Nov 27, 2025Updated 11 months ago
- LLM training parallelisms (DP, FSDP, TP, PP) in pure C☆29Jan 27, 2026Updated 9 months ago
- an auto-sleeping and -waking framework around llama.cpp☆13Feb 8, 2025Updated last year
- QQQ is an innovative and hardware-optimized W4A8 quantization solution for LLMs.☆162Aug 21, 2025Updated last year
- Paper to Reviewer Assignment is a tedious but a very crucial job for conference organizers. Till date the Toronto Paper Matching System (…☆10Nov 30, 2017Updated 8 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- FlashInfer: Kernel Library for LLM Serving☆6,828Updated this week
- ☆13Aug 10, 2026Updated 2 months ago
- official code for GliDe with a CaPE☆21Aug 13, 2024Updated 2 years ago
- Your ddl-tracker for CCF conferences, now in your menu bar!☆12Jun 2, 2026Updated 5 months ago
- 海龟汤mcp服 务，使你独自一人也可以享受海龟汤游戏的乐趣☆14Apr 8, 2025Updated last year
- Creative commons texts from Oxford Text Archive☆11Jun 30, 2016Updated 10 years ago
- Speculative Decoding Meets Quantization: Compatibility Evaluation and Hierarchical Framework Design☆26May 29, 2025Updated last year