A single-file educational implementation for understanding vLLM's core concepts and running LLM inference.
☆47Apr 7, 2026Updated 6 months ago
Alternatives and similar repositories for cleanvllm
Users that are interested in cleanvllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Nano vLLM☆25Aug 11, 2025Updated last year
- RLVR training for LLM in CUDA/C++☆42Jul 25, 2026Updated 2 months ago
- LLM training parallelisms (DP, FSDP, TP, PP) in pure C☆29Jan 27, 2026Updated 8 months ago
- Implement some method of LLM KV Cache Sparsity☆41Jun 6, 2024Updated 2 years ago
- RapidLLM is an LLM inference framework with continuous batching, tensor and data parallelism, quantized weights, and with pluggable Trito…☆195Oct 10, 2026Updated last week
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Super fast serving stack for LLM on Windows/Linux/Macos☆17Updated this week
- Nano vLLM☆13Jun 26, 2025Updated last year
- Draft-Target Disaggregation LLM Serving System via Parallel Speculative Decoding.☆223Mar 18, 2026Updated 6 months ago
- This project aims to provide a high effective KV cache manage framework for llm inference and improve memory utilization and inference sp…☆75Apr 24, 2026Updated 5 months ago
- ☆107Sep 9, 2024Updated 2 years ago
- ☆11Mar 9, 2022Updated 4 years ago
- ☆13Jun 16, 2024Updated 2 years ago
- ☆19Apr 15, 2025Updated last year
- [IPDPS 2024] Adaptive neighbor sampling for temporal GNN☆16Feb 17, 2025Updated last year
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- CPM.cu is a lightweight, high-performance CUDA implementation for LLMs, optimized for end-device inference and featuring cutting-edge tec…☆242Jan 14, 2026Updated 9 months ago
- FlexAttention based, minimal vllm-style inference engine for fast Gemma 2 inference.☆362Nov 2, 2025Updated 11 months ago
- 用pytorch训练18层残差神经网络，用pyqt设计界面☆12Jun 23, 2020Updated 6 years ago
- Single-file truly minimal implementation of state-of-the-art reinforcement learning algorithms.☆21Feb 13, 2023Updated 3 years ago
- My learning notes for ML&SYS.☆13Mar 27, 2026Updated 6 months ago
- [ICLR 2025] PEARL: Parallel Speculative Decoding with Adaptive Draft Length☆172Dec 23, 2025Updated 9 months ago
- 一个即插即用的llm增强器，项目初衷是通过 工程化架构让小参数模型获得能媲美大模型的能力。☆19May 23, 2026Updated 4 months ago
- Efficient, Flexible, and Highly Fault-Tolerant Model Service Management Based on SGLang☆63Nov 8, 2024Updated last year
- ☆21Dec 22, 2020Updated 5 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Deep reinforcement learning implementation that trains AIs for the CodeCraft real-time strategy game.☆21May 22, 2023Updated 3 years ago
- [ACL 2026 Main] See the Forest for the Trees: Loosely Speculative Decoding via Visual-Semantic Guidance for Efficient Inference of Video …☆31Jul 4, 2026Updated 3 months ago
- minimal C implementation of speculative decoding based on llama2.c☆30Jul 15, 2024Updated 2 years ago
- Nano vLLM v1 engine☆15Aug 6, 2025Updated last year
- The simplest implementation of recent Sparse Attention patterns for efficient LLM inference.☆93Jul 17, 2025Updated last year
- DiTAS: Quantizing Diffusion Transformers via Enhanced Activation Smoothing (WACV 2025)☆13Feb 7, 2026Updated 8 months ago
- Zeta implementation of a reusable and plug in and play feedforward from the paper "Exponentially Faster Language Modeling"☆16Nov 11, 2024Updated last year
- Estimate Your LLM's Token Toll Across Various Platforms and Configurations☆39Nov 9, 2025Updated 11 months ago
- QuantLLM is a Python library designed for developers, researchers, and teams who want to fine-tune and deploy large language models (LLMs…☆17Aug 4, 2026Updated 2 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆26Jan 18, 2026Updated 8 months ago
- 📚 LaTeX templates and tools for creating beautiful, structured documents 📝☆14Oct 24, 2025Updated 11 months ago
- Flash Attention from Scratch on CUDA Ampere☆201Sep 1, 2025Updated last year
- The grc file enables the HackRF transmit on mutiple(example is 3) freqeuncy within in band(20 MHz)☆10Sep 5, 2023Updated 3 years ago
- A simple 2D ball collision engine.☆12Jun 15, 2023Updated 3 years ago
- Applying PBT optimization technique to different domains☆10Oct 16, 2019Updated 7 years ago
- Official codebase for Adaptive Online Planning for Continual Lifelong Learning.☆17Mar 26, 2020Updated 6 years ago