A single-file educational implementation for understanding vLLM's core concepts and running LLM inference.
☆47Apr 7, 2026Updated 6 months ago
Alternatives and similar repositories for cleanvllm
Users that are interested in cleanvllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Radix Tree KV Cache with Turn-Aware Growth☆12Jul 21, 2025Updated last year
- RLVR training for LLM in CUDA/C++☆42Jul 25, 2026Updated 3 months ago
- Nano vLLM☆15Jun 1, 2026Updated 5 months ago
- LLM training parallelisms (DP, FSDP, TP, PP) in pure C☆29Jan 27, 2026Updated 9 months ago
- Mini-SGLang is a mini version of SGLang project ().☆13Sep 24, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆10Dec 6, 2022Updated 3 years ago
- This is the public repo for DREAM accepted to ICS 2025.☆12Dec 28, 2025Updated 10 months ago
- RapidLLM is an LLM inference framework with continuous batching, tensor and data parallelism, quantized weights, and with pluggable Trito…☆196Oct 10, 2026Updated 3 weeks ago
- Implement some method of LLM KV Cache Sparsity☆41Jun 6, 2024Updated 2 years ago
- Super fast serving stack for LLM on Windows/Linux/Macos☆17Oct 22, 2026Updated 2 weeks ago
- High Performance Quantative Finance on JAX☆13Jun 28, 2022Updated 4 years ago
- Draft-Target Disaggregation LLM Serving System via Parallel Speculative Decoding.☆224Mar 18, 2026Updated 7 months ago
- ☆15Updated this week
- This project aims to provide a high effective KV cache manage framework for llm inference and improve memory utilization and inference sp…☆75Apr 24, 2026Updated 6 months ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Nano vLLM☆13Jun 26, 2025Updated last year
- ☆13Jun 16, 2024Updated 2 years ago
- ☆19Apr 15, 2025Updated last year
- ☆107Sep 9, 2024Updated 2 years ago
- FlexAttention based, minimal vllm-style inference engine for fast Gemma 2 inference.☆363Nov 2, 2025Updated last year
- Rime（中州韵）输入法通过「反查（reverse lookup）」功能实现拆字输入，避免导入词库在其他拼音出现 u 时的卡顿情况。同时可以查看拼音。 基于「 chaizi 」词库，修改自「两分输入法」。目前只针对汉语拼音（朙月拼音等）。☆11May 11, 2024Updated 2 years ago
- High Dynamic Range Video Compression: A Large-Scale Benchmark Dataset and A Learned Bit-depth Scalable Compression Algorithm☆13Mar 4, 2025Updated last year
- Single-file truly minimal implementation of state-of-the-art reinforcement learning algorithms.☆21Feb 13, 2023Updated 3 years ago
- [ICLR 2025] PEARL: Parallel Speculative Decoding with Adaptive Draft Length☆173Dec 23, 2025Updated 10 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆15Jun 10, 2026Updated 4 months ago
- 一个即插即用的llm增强器，项目初衷是通过工程化架构让小参数模型获得能媲美大模型的能力。☆19May 23, 2026Updated 5 months ago
- A sparse-first inference engine (SparseEngine).☆107Updated this week
- minimal C implementation of speculative decoding based on llama2.c☆30Jul 15, 2024Updated 2 years ago
- 用pytorch训练18层残差神经网络，用pyqt设计界面☆12Jun 23, 2020Updated 6 years ago
- CSEDB - Clinical Safety-Effectiveness Dual-Track Benchmark☆22Aug 13, 2025Updated last year
- [IPDPS 2024] Adaptive neighbor sampling for temporal GNN☆16Feb 17, 2025Updated last year
- Actor-Sharer-Learner training framework for off-policy DRL algorithms☆22Dec 29, 2024Updated last year
- The simplest implementation of recent Sparse Attention patterns for efficient LLM inference.☆93Jul 17, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Author's PyTorch Implementation of Deep Homomorphic Policy Gradient (DHPG) - NeurIPS 2022 and JMLR 2024☆24Apr 8, 2024Updated 2 years ago
- 尚观嵌入式课程QT图形界面课程☆11Dec 26, 2016Updated 9 years ago
- Nano vLLM with vLLM v1's request scheduling strategy and chunked prefill☆104Jan 26, 2026Updated 9 months ago
- Nano vLLM v1 engine☆15Aug 6, 2025Updated last year
- [ACL 2026 Main] See the Forest for the Trees: Loosely Speculative Decoding via Visual-Semantic Guidance for Efficient Inference of Video …☆32Jul 4, 2026Updated 4 months ago
- Efficient, Flexible, and Highly Fault-Tolerant Model Service Management Based on SGLang☆64Nov 8, 2024Updated last year
- ☆16Feb 20, 2024Updated 2 years ago