a community oriented 1:1, vLLM-alike (Continuous batching, paged KV) engine in C++ with additional features (GGUF, RadixAttention, Cache-aware scheduling, ...)
☆446Oct 9, 2026Updated this week
Alternatives and similar repositories for vllm.cpp
Users that are interested in vllm.cpp are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 🎮 A Game Engine for your Terminal☆17Sep 18, 2026Updated 3 weeks ago
- Understanding ComfyUI seed☆16May 25, 2024Updated 2 years ago
- A lightweight, graph-based Semantic Layer for Python and SQL☆19Mar 13, 2026Updated 6 months ago
- Minimalistic batching application for LLMs using ASP.NET Core and LLamaSharp☆12Oct 23, 2024Updated last year
- Port of Mistral's Voxtral model in C/C++☆36Jun 19, 2026Updated 3 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Fedimint Federation Explorer☆15Sep 21, 2026Updated 2 weeks ago
- Keqing themed cursor available for Windows and Linux.☆11May 27, 2022Updated 4 years ago
- An AeroSnap-like replacement that is user-configurable☆15Aug 11, 2018Updated 8 years ago
- Feminized PAC-MAN remake.☆17Jun 8, 2024Updated 2 years ago
- Help work on the Polybius ACO protram☆15Feb 23, 2026Updated 7 months ago
- This project aims to wrap the complete [Pdfium](https://pdfium.googlesource.com/pdfium/) API in dart, over FFI.☆17Jan 8, 2026Updated 9 months ago
- Terry's 1st Temple☆20Sep 4, 2024Updated 2 years ago
- Ongoing formal verification for Asterinas OSTD☆54Updated this week
- An ETW EventSource Tracing Core build on .Net Standard 2.0☆11Jun 23, 2022Updated 4 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Official AMD catalog of AI agent skills. Empower your AI agents with AMD's optimized SW stack.☆406Updated this week
- A DSL optimized for LLM code generation - outperforms Python on data transformation tasks☆18Feb 26, 2026Updated 7 months ago
- Production-ready ternary quantized (1.58-bit) Rust code generation model with mHC-lite, MaxRL training, and comprehensive benchmarking☆22Aug 2, 2026Updated 2 months ago
- Experimental LLM interface exploring new ways to use AI to improve human thinking☆21Apr 13, 2026Updated 5 months ago
- A process manager for linux, mac & windows to simplify your developer environment.☆44Jun 17, 2026Updated 3 months ago
- A game using assets generated by Meshy.ai☆27Jun 8, 2024Updated 2 years ago
- Wan2.1, quantized and optimized so it fits on your 3090/4090☆34Feb 27, 2025Updated last year
- Tooling for a minimalist data lab running on top of DuckLake.☆36Jan 5, 2026Updated 9 months ago
- Open Source Flutter Fedimint App☆32Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A customizable DataTable with horizontal scrolling, cursor and offset pagination, sorting, filtering, editable columns, and expandable ro…☆27Jan 2, 2025Updated last year
- A 3D space mining game.☆30May 18, 2024Updated 2 years ago
- A new package- and version manager for zig.☆37Jun 1, 2026Updated 4 months ago
- Takum arithmetic C99 reference implementation☆26Nov 24, 2025Updated 10 months ago
- Manages the context menu for your Linux tools in WSL/WSL2 for Windows.☆31Aug 21, 2020Updated 6 years ago
- Create data pipeline with sqlmesh orchestrated by dagster☆30Oct 27, 2025Updated 11 months ago
- Fire a custom "create" event when new, matching elements are inserted into the DOM.☆31Jul 11, 2011Updated 15 years ago
- Advanced sampling nodes optimized for ACE-Step audio generation in ComfyUI.☆32Dec 12, 2025Updated 9 months ago
- SR²AM: Efficient Agentic Reasoning Through Self-Regulated Simulative Planning☆21May 22, 2026Updated 4 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Debug & verify the contents of your Netlify build cache☆18Jul 11, 2023Updated 3 years ago
- Interactive visualization of Manifold-Constrained Hyper-Connections (mHC) for stable deep network training☆28Jul 4, 2026Updated 3 months ago
- Documentation:☆19May 2, 2025Updated last year
- Linux support for the 3Dconnexion SpaceBall, SpaceNavigator and joysticks in the SecondLife clients☆15Aug 20, 2025Updated last year
- An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.☆22Nov 28, 2022Updated 3 years ago
- [ICLR2025 Spotlight] Advantage-Guided Distillation for Preference Alignment in Small Language Models☆27Feb 10, 2025Updated last year
- A cross-platform command line terminal program to get stock quotes and other financial data. Written in .net core.☆19Jun 5, 2018Updated 8 years ago