Nano vLLM
☆15Jun 1, 2026Updated 5 months ago
Alternatives and similar repositories for nano-vllm-speculative-decoding
Users that are interested in nano-vllm-speculative-decoding are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- EMNLP 2025☆14Nov 28, 2024Updated last year
- Nano vLLM Triton☆14Aug 27, 2025Updated last year
- nano-vllm是开源的一个gpu推理项目,基于开源版本弄的一个ascend npu版本推理小demo,旨在帮助初学者了解推理的整体流程,区别于vllm,nano-vllm体量更小,麻雀虽小五脏俱全,更有助于初学者学习。☆96May 4, 2026Updated 6 months ago
- [ACL 2026 (Main)] LongSpec: Long-Context Lossless Speculative Decoding with Efficient Drafting and Verification☆86Jul 14, 2025Updated last year
- Draft-Target Disaggregation LLM Serving System via Parallel Speculative Decoding.☆227Mar 18, 2026Updated 7 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- [ACL 26 Findings] LogitSpec: Accelerating Retrieval-based Speculative Decoding via Next Next Token Speculation☆13Apr 21, 2026Updated 6 months ago
- Reading notes on Speculative Decoding papers☆50Jun 2, 2026Updated 5 months ago
- Nano vLLM☆13Jun 26, 2025Updated last year
- ☆14Jan 24, 2023Updated 3 years ago
- 基于numpy的smpl算法☆12Aug 25, 2021Updated 5 years ago
- The official repo of "Draft-OPD: On-Policy Distillation for Speculative Draft Models"☆85Sep 4, 2026Updated 2 months ago
- Official implementation for "K-Forcing: Joint Next-K-Token Decoding via Push-Forward Language Modeling"☆19Aug 16, 2026Updated 3 months ago
- ☆20Dec 24, 2024Updated last year
- ☆53Sep 13, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- The official code repo and data hub of top_nsigma sampling strategy for LLMs.☆29Feb 11, 2025Updated last year
- ☆14Oct 24, 2024Updated 2 years ago
- Cluster Far Mem, framework to execute single job and multi job experiments using fastswap☆21Jan 12, 2024Updated 2 years ago
- CuTeDSL tutorials, tools, autotuner, profiler, etc.☆47Jun 27, 2026Updated 4 months ago
- WideSWE: Can Coding Agents Coordinate Changes Across Repositories?☆21Oct 13, 2026Updated last month
- Nano vLLM v1 engine☆15Aug 6, 2025Updated last year
- The Python code of a deep-unfolding algorithm for weighted sum rate maximization (WSRMax) precoding design in multiuser MIMO systems☆13Apr 25, 2023Updated 3 years ago
- Official code repository for "CoVA: Exploiting Compressed-Domain Analysis to Accelerate Video Analytics [USENIX ATC 22]"☆21Sep 19, 2024Updated 2 years ago
- Hungarian algorithm for linear sum assignment. Works for square and rectangular matrices.☆10May 16, 2017Updated 9 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- DuoDecoding: Hardware-aware Heterogeneous Speculative Decoding with Dynamic Multi-Sequence Drafting☆20Mar 4, 2025Updated last year
- [ICLR 2025] PEARL: Parallel Speculative Decoding with Adaptive Draft Length☆175Dec 23, 2025Updated 10 months ago
- Boosting GPU utilization for LLM serving via dynamic spatial-temporal prefill & decode orchestration☆57Sep 23, 2026Updated last month
- ☆27Oct 30, 2026Updated 2 weeks ago
- Lightweight LLM inference engine inspired by nano-vllm, with radix-tree based prefix cache, tp & pp, cuda graph, openai api, async schedu…☆17Mar 29, 2026Updated 7 months ago
- Made a CPU in Logisim when I was 14 (2009), and wrote a naive assembler and compiler for it in Flash. The CPU's design is inspired by Don…☆10Sep 30, 2016Updated 10 years ago
- ☆11Oct 29, 2026Updated 2 weeks ago
- ☆15Jul 6, 2024Updated 2 years ago
- Very small and high performance CPU☆13Dec 3, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- IntelliJ ExcelReader Plugin☆12Aug 8, 2024Updated 2 years ago
- ☆34Sep 9, 2020Updated 6 years ago
- Minimal uart for small iCE40 Lattice FPGAs. 8N1. 32 or 34 logicCells☆10Jul 20, 2017Updated 9 years ago
- 使用ISTANet网络重构压缩感知采样的1维光谱信号☆14Oct 12, 2023Updated 3 years ago
- ☆12May 8, 2026Updated 6 months ago
- Music算法仿真实验☆15Dec 21, 2018Updated 7 years ago
- a simple new ISA nnISA and nnSOC nnCPU nnAs nnCc☆10Mar 15, 2020Updated 6 years ago
Are these results useful?