A high-throughput and memory-efficient inference and serving engine for LLMs
β16Oct 26, 2025Updated last year
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- π₯· The open framework for building AI Assistantsβ18Feb 21, 2025Updated last year
- A Reliable, Customize-able, and Scalable Zapier Alternative for Production-Grade Workflow Automationβ14Nov 11, 2024Updated last year
- An AI IDE secure coding MCP serviceβ12Nov 3, 2025Updated 11 months ago
- NoxuOS is an AI driven OSβ14Dec 28, 2024Updated last year
- A kit with kernels, bootloaders, and firmware packaged for Bottlerocketβ14Oct 21, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer β’ AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- OSKM εΌζΊη₯θ―ε°εΎ Knowledge Map of Open Sourceβ11Oct 10, 2023Updated 3 years ago
- [NeurIPS 2025] The official repo of SynLogic: Synthesizing Verifiable Reasoning Data at Scale for Learning Logical Reasoning and Beyondβ211Jul 7, 2025Updated last year
- The First Step Towards AI-Native Linux OS - Natural language system administration with Gemini AIβ19Jul 2, 2025Updated last year
- LLM Assistent with Chat Integrationβ14Sep 5, 2024Updated 2 years ago
- User-space Linux tool to simulate input devices (keyboard, mouse, gamepad) using uinputβ14Feb 25, 2026Updated 8 months ago
- Unofficial/Unsolicited ArtStation client with an Instagram inspired feedβ11Feb 14, 2026Updated 8 months ago
- β15Jun 20, 2026Updated 4 months ago
- β15Feb 2, 2026Updated 8 months ago
- lmdb bindings for odinβ10Feb 5, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient β’ AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Immutable Linux distribution based on Gentoo, BtrFS, and Cosmic-Desktop.β14Sep 13, 2026Updated last month
- Traditional operating systems are reactive - they wait for user input or system events before taking action. SwarmOS breaks this paradigmβ¦β16Dec 6, 2024Updated last year
- A sub-1KB, self-hosting, native code Forth without compromiseβ11May 4, 2026Updated 5 months ago
- Platform abstraction and utility libraryβ19Jun 12, 2026Updated 4 months ago
- High-resolution screenshot capture plugin for IDA Proβ13May 31, 2024Updated 2 years ago
- Community list of: AI, ML, IoT, big&open data & co.: The evolving eco-system of machine-assisted transport planning, management and operaβ¦β12Sep 30, 2024Updated 2 years ago
- Odin bindings for fasm, the flat assemblerβ11Aug 20, 2026Updated 2 months ago
- Hybrid portable GUI system for Odinβ12Aug 2, 2026Updated 2 months ago
- Rewrite of CTime by Casey Muratori in Odinβ11Jan 30, 2020Updated 6 years ago
- GPU virtual machines on DigitalOcean Gradient AI β’ AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Proof assistantβ13Dec 18, 2025Updated 10 months ago
- Open-source coding agent like Cursor/Windsurf in your browserβ18Jul 9, 2025Updated last year
- A git mirror of vasm - A portable and retargetable assemblerβ10Nov 27, 2019Updated 6 years ago
- A generational arena allocator for javascriptβ13Nov 13, 2020Updated 5 years ago
- β12May 16, 2020Updated 6 years ago
- not infinite, but huge canvas collaborative vector drawing programβ13Oct 28, 2018Updated 8 years ago
- Lua with 0-based array indexingβ13Jul 6, 2024Updated 2 years ago
- MATLAB implementation of a mixed integer linear programming problem (MILP) to find an approximation to the optimal operation of the virtuβ¦β11Jun 27, 2021Updated 5 years ago
- AMD FEMFX Plugin for Unreal Engine 5.3β12May 18, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer β’ AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Various agents from all of the top agent frameworks to integrate into swarms! Langchain, Griptape, CrewAI, and more!β17Dec 22, 2025Updated 10 months ago
- moderngpu algorithms for C++ shadersβ16Mar 3, 2021Updated 5 years ago
- Twitter thread explorer made in C++/Wasm/WebGLβ12May 16, 2023Updated 3 years ago
- Unicode Character Database (UCD) Toolsβ13May 9, 2021Updated 5 years ago
- Common interface for interacting with AI agents. The protocol is tech stack agnostic - you can use it with any framework for building ageβ¦β22Jul 3, 2024Updated 2 years ago
- The "downstream" open source version of the core OstrichDB engine and API layer that powers OstrichDB.comβ11Sep 30, 2025Updated last year
- Personal AI assistant for saving and chatting with web content.β16Feb 19, 2026Updated 8 months ago