The fastest off-the-shelf inference algorithm for LLMs (ICLR’25)
☆14Mar 8, 2025Updated last year
Alternatives and similar repositories for distributed-speculative-inference
Users that are interested in distributed-speculative-inference are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Accepted by NAACL 2025 main conference.☆11Jan 24, 2025Updated last year
- Pytorch implementation of "Estimating the Success of Unsupervised Image to Image Translation" ECCV 2018☆18Apr 6, 2019Updated 7 years ago
- Continuous Pipelined Speculative Decoding☆22May 25, 2026Updated 5 months ago
- [ICLR 2026] Towards Robust Real-World Multivariate Time Series Forecasting: A Unified Framework for Dependency, Asynchrony, and Missingne…☆12Feb 24, 2026Updated 8 months ago
- Multi-Candidate Speculative Decoding☆41Apr 22, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ChatGPT Team 邀请自动化系统 - Cloudflare Workers 部署☆17Dec 21, 2025Updated 10 months ago
- ☆19Nov 7, 2026Updated last week
- Keeping It Simple is Hard☆11Feb 12, 2024Updated 2 years ago
- Load, build and explore Patstat using the Google Cloud Platform☆10Jan 19, 2019Updated 7 years ago
- Adapt full attention LLM to sliding window attention☆14Feb 20, 2026Updated 8 months ago
- Material parsers and other tools, scripts Initially developed for Grobid Superconductor☆14Feb 21, 2025Updated last year
- MatSci-LumEn: Materials Science Large Language Models Evaluation for text and data mining☆12Aug 8, 2026Updated 3 months ago
- A machine learning software for extracting astronomical entities from scholarly documents☆10Oct 31, 2022Updated 4 years ago
- [ICLR 2025] PEARL: Parallel Speculative Decoding with Adaptive Draft Length☆175Dec 23, 2025Updated 10 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Bouton ISTEX : extension web capable d'insérer dynamiquement sur la page web consultée un lien vers le fulltext d'un document si ce dern…☆11May 30, 2023Updated 3 years ago
- 吴恩达深度学习课程笔记PyTorch版☆21Nov 2, 2025Updated last year
- Official implementation for KDD'25 paper "Unleashing The Power of Pre-Trained Language Models for Irregularly Sampled Time Series".☆19Nov 28, 2025Updated 11 months ago
- Repository hosting the common code for the entity-fishing clients☆10May 18, 2026Updated 5 months ago
- The EHRI project's portal interface.☆15Updated this week
- The grobidmonkey package is an open-source package designed for postprocessing GROBID outputs.☆12Mar 27, 2024Updated 2 years ago
- Poor man's simple harvester for arXiv resources☆14Jul 14, 2023Updated 3 years ago
- Our math research agent☆42May 21, 2026Updated 5 months ago
- Backend, IA-specific tools for crawling and processing the scholarly web. Content ends up in https://fatcat.wiki☆28Jul 31, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Official implementation of "Learning To Draft: Adaptive Speculative Decoding with Reinforcement Learning" (ICLR 2026)☆24Mar 1, 2026Updated 8 months ago
- Ubuntu 23.10 and 22.04 for Android Termux, No root required☆12Sep 3, 2024Updated 2 years ago
- ☆19Sep 26, 2026Updated last month
- Yet Another LLM Inference System☆18Mar 1, 2026Updated 8 months ago
- WindSR Dataset contains more than 22,000 pairs of HR/LR wind speed images, which are processed using the NASA's GEOS-5 Nature Run dataset…☆12Jan 18, 2024Updated 2 years ago
- This repository contains the codebase for the paper Route to Reason: Adaptive Routing for LLM and Reasoning Strategy Selection☆11Jun 30, 2025Updated last year
- [ICML 2025] AdaDecode: Accelerating LLM Decoding with Adaptive Layer Parallelism☆20Jul 14, 2025Updated last year
- A browser extension providing Open Access bibliographical services☆18Dec 9, 2022Updated 3 years ago
- Natural language detection, Java bindings for CLD2☆20Nov 3, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- pure go for rwkv☆18Dec 31, 2023Updated 2 years ago
- Specification of a stand-off element for the TEI guidelines☆12Apr 29, 2021Updated 5 years ago
- ☆15Dec 18, 2023Updated 2 years ago
- Utility to compile string of chemical terms into data structure with chemical formula and composition☆14Sep 17, 2021Updated 5 years ago
- StarryDigitizer is a Vue.js-based tool for extracting numeric data from plot images, supporting XY data.☆14Oct 18, 2026Updated 3 weeks ago
- ☆13Jan 22, 2025Updated last year
- Annotation tool (NER) for XML documents (TEI, EAD) - WIP☆11Jul 22, 2022Updated 4 years ago
Are these results useful?