A compact implementation of vLLM, designed to demystify the complexities of modern LLM serving systems.
☆21Sep 7, 2026Updated last month
Alternatives and similar repositories for mini-vllm
Users that are interested in mini-vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Local-first cross-session long-term memory for DeepSeek Harness — 22 narrow tools, hybrid FTS5 + local-vector retrieval, evidence gate, p…☆38Updated this week
- From-scratch multi-GPU LLM inference engine: paged KV cache, continuous batching, prefix caching, tensor parallelism, OpenAI-compatible s…☆28Sep 25, 2026Updated last month
- Discrete Event Simulations☆13Nov 21, 2021Updated 4 years ago
- Lightweight LLM inference engine inspired by nano-vllm, with radix-tree based prefix cache, tp & pp, cuda graph, openai api, async schedu…☆17Mar 29, 2026Updated 6 months ago
- Rewrite of popular AdminLTE in AngularJS☆10Oct 21, 2014Updated 12 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Optimize SGEMM step by step☆10Sep 4, 2024Updated 2 years ago
- ☆12Mar 29, 2025Updated last year
- ☆11Mar 21, 2023Updated 3 years ago
- An implementation of the hallucination mitigation method "REVIS" introduced in "Sparse Latent Steering to Mitigate Object Hallucination i…☆16Feb 12, 2026Updated 8 months ago
- This is the Mathslate editor adapted as a standard plugin for TinyMCE4☆11Apr 23, 2017Updated 9 years ago
- INSPIRE: Intensity and Spatial Information-Based Deformable Image Registration☆12Jun 30, 2021Updated 5 years ago
- 2024华为嵌入式软件大赛-算法组 冠军队伍题解☆13Aug 5, 2024Updated 2 years ago
- ☆15Jun 23, 2026Updated 4 months ago
- [TSE 2024] APPT: Boosting Automated Patch Correctness Prediction via Fine-tuning Pre-trained Models☆16Jan 29, 2024Updated 2 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- a simple python tool that helps generate csv files from a json file☆13Sep 12, 2015Updated 11 years ago
- golang实现的内网穿透，go语言编写，无第三方依赖☆18Jun 9, 2019Updated 7 years ago
- [AAAI 2026] ReCode: Reinforced Code Knowledge Editing for API Updates☆26Jul 1, 2025Updated last year
- Rust bindings to the KVM interface☆17Jun 20, 2019Updated 7 years ago
- a cloud-native workflow engine, also known as KubeAdaptor, a docking framework able to implement workflow containerization on Kubernetes…☆13Apr 21, 2022Updated 4 years ago
- java实现对服务器的自动巡检故障通知，Java to achieve the automatic inspection of the server failure notice☆12Dec 9, 2022Updated 3 years ago
- ☆17Jan 8, 2025Updated last year
- Image registration between visible and infrared images is realized by morphological method☆11Jul 21, 2018Updated 8 years ago
- PostgreSQL extension for recoding workload of specific database☆12Mar 21, 2016Updated 10 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- A straightforward implementation of EGBM-based Generalized Additive Model☆13Oct 15, 2020Updated 6 years ago
- ☆10Feb 12, 2021Updated 5 years ago
- PostgreSQL extension to log SQL statements for specific server processes.☆12Feb 17, 2024Updated 2 years ago
- 从零做操作系统☆24Mar 10, 2015Updated 11 years ago
- ☆14May 27, 2024Updated 2 years ago
- Bookmark your web pages to Pocket☆10Jul 26, 2015Updated 11 years ago
- A demo for c6 chart library for node.js (based on Electron.js)☆16Jun 20, 2017Updated 9 years ago
- Sockets in Sails☆10Dec 12, 2014Updated 11 years ago
- a mongodb wrapper, make everything return promise.☆13May 8, 2016Updated 10 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- 跟我一起写 Makefile (Markdown重制版 )☆15May 29, 2024Updated 2 years ago
- 截取iPad上京东阅读的书籍，自动保存为pdf☆11Nov 27, 2018Updated 7 years ago
- AI Infra / 机器学习系统面经（305 题）☆47May 5, 2026Updated 5 months ago
- A set of tools to analyze query workloads☆13Jul 27, 2026Updated 2 months ago
- Multiple Generalized Additive Models implemented in Python (EBM, XGB, Spline, FLAM). Code for our KDD 2021 paper "How Interpretable and T…☆14Aug 15, 2021Updated 5 years ago
- ☆14Apr 24, 2023Updated 3 years ago
- ☆11Nov 2, 2022Updated 3 years ago