Speculative Decoding Implementations: MTP, EAGLE-3, Medusa-1, PARD, Draft Models, N-gram and Suffix Decoding from scratch
☆15May 2, 2026Updated 6 months ago
Alternatives and similar repositories for Speculative-Decoding
Users that are interested in Speculative-Decoding are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Universal cognitive engine for AI. Features autonomy, self-reflection, and continuous learning via the Nine Questions loop.☆14Jun 13, 2026Updated 4 months ago
- A funny experiment with llama.cpp driving robots☆14Jul 27, 2026Updated 3 months ago
- Multi-dataset evaluation of Anthropic's J-Space on Qwen3-4B. Demonstrates that internal 'workspace noise' can reliably route high-confide…☆12Jul 13, 2026Updated 3 months ago
- A minimal AI agent that gives an LLM a handful of tools, then gets out of the way.☆13Updated this week
- Huggingface but for inference engines.☆14Updated this week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- cause measuring models sans harness is like ignoring weather appropriate clothing☆14Apr 18, 2026Updated 6 months ago
- Multi-agent orchestration framework for AI applications - build, deploy, and manage AI agents across the full lifecycle with Forge, Conve…☆33Mar 28, 2026Updated 7 months ago
- A simple, "Ollama-like" tool for managing and running GGUF language models from your terminal.☆25Jan 2, 2026Updated 10 months ago
- A text-grid web renderer for AI agents — see the web without screenshots☆103Mar 10, 2026Updated 8 months ago
- A script to process ebooks into slideshows or movies through the use of several different types of generative AI.☆13Feb 20, 2026Updated 8 months ago
- Local hybrid RAG over a code knowledge graph. Indexes your codebase with tree-sitter + embeddings + a relationship graph and serves preci…☆15May 29, 2026Updated 5 months ago
- ☆14Apr 13, 2026Updated 6 months ago
- Unlock clock & power control on the AMD Radeon Pro V620 in passthrough VMs — 4-byte VBIOS pptable patch via QEMU romfile, no flash, no CU…☆20Jul 24, 2026Updated 3 months ago
- Ekbasis: an open world model for agents. What an action will do, before it is done.☆18Oct 16, 2026Updated 3 weeks ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- The spatial operating environment for autonomous AI agents.☆18Nov 3, 2026Updated last week
- LLM-powered research knowledge base — compile raw documents into a living wiki with persistent agent memory and RAG retrieval.☆14Apr 5, 2026Updated 7 months ago
- A bytebot variant that uses Holo 1.5 7b to control the desktop☆25Nov 4, 2025Updated last year
- ☆18Dec 1, 2025Updated 11 months ago
- A web frontend for managing an EmpyrionServer (similar to the EAH), as a MOD so that it can also be used seemless in game hosting.☆24Aug 3, 2026Updated 3 months ago
- Rank any list by any criteria at any scale using LLMs as judges.☆30Oct 19, 2026Updated 3 weeks ago
- An educational Rust project for exporting and running inference on Qwen3 LLM family☆44Aug 3, 2025Updated last year
- A transparent (O)llama proxy with model deployment aware routing which auto-manages multiple (O)llama instances in a given network.☆20Apr 14, 2026Updated 6 months ago
- fast_argv☆16May 15, 2026Updated 5 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Let AI Agents control your real firefox browser: fill forms, authenticate, automate actions, web development; all via token-efficient, ea…☆32Oct 22, 2026Updated 3 weeks ago
- 3.34× faster inference on Apple Silicon: native MLX port of DFlash speculative decoding☆19Oct 7, 2026Updated last month
- Zero-instrumentation LLM API and MCP tracer for your agents powered by eBPF — latency, tokens, and tool use in realtime☆19Mar 16, 2026Updated 7 months ago
- ☆15Mar 18, 2026Updated 7 months ago
- Lightweight API Specification for Intelligent Systems☆17Sep 8, 2026Updated 2 months ago
- A yabai status bar widget for Übersicht☆18Dec 20, 2020Updated 5 years ago
- A node.js client for clojure NREPL servers☆11Aug 11, 2016Updated 10 years ago
- An AI assistant for PCs powered by Meta's LLaMA3 using Hugging Face, runs on voice recognition, text-to-speech. Send messages, voice/vide…☆21Jun 6, 2024Updated 2 years ago
- Harn is a programming language and runtime for building AI agents.☆31Updated this week
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Reversible PII masking for LLM agents: piighost replaces personal data with placeholders before the model sees it, then restores the real…☆18Updated this week
- Write data to files split by topic and rolled over on size or a timeout, files can be compressed using lzo, snappy or gzip☆11Jul 12, 2021Updated 5 years ago
- A Clojure library to identify .jars containing transitive AOT dependencies☆12Jan 22, 2018Updated 8 years ago
- ☆20Jan 3, 2026Updated 10 months ago
- Full (as far as I'm aware) firmware dump of the Arcadyan AW1000, aka Telstra 5G Smart Modem.☆12Mar 28, 2022Updated 4 years ago
- My portfolio 🧑🚀☆23Updated this week
- a terminal based GPS tool.☆18Dec 8, 2025Updated 11 months ago
Are these results useful?