A high-throughput and memory-efficient inference and serving engine for LLMs
β16Oct 26, 2025Updated last year
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- MiniMax Search is an MCP (Model Context Protocol) server that provides web search and browsing capabilities.β64Nov 3, 2025Updated last year
- π₯· The open framework for building AI Assistantsβ18Feb 21, 2025Updated last year
- CodeGuardian is an intelligent agent designed to automate the generation of production-grade unit tests for your Python code.β11Oct 13, 2025Updated last year
- OSKM εΌζΊη₯θ―ε°εΎ Knowledge Map of Open Sourceβ11Oct 10, 2023Updated 3 years ago
- A compile time sized array of bitsβ12Aug 15, 2021Updated 5 years ago
- Deploy on Railway without the complexity - Free Credits Offer β’ AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- NoxuOS is an AI driven OSβ14Dec 28, 2024Updated last year
- A collection of personal, single-header C and C++ libraries similar to the STB libraries. All avaliable in the public domain.β14Feb 23, 2023Updated 3 years ago
- An operating system in your terminalβ17Mar 25, 2025Updated last year
- β15Jun 20, 2026Updated 4 months ago
- Odin bindings for mimalloc (https://github.com/microsoft/mimalloc). mimalloc is a compact general purpose allocator with excellent perforβ¦β11May 29, 2023Updated 3 years ago
- Traditional operating systems are reactive - they wait for user input or system events before taking action. SwarmOS breaks this paradigmβ¦β16Dec 6, 2024Updated last year
- lmdb bindings for odinβ10Feb 5, 2024Updated 2 years ago
- Immutable Linux distribution based on Gentoo, BtrFS, and Cosmic-Desktop.β14Sep 13, 2026Updated 2 months ago
- A customized version of the Fallout GRUB theme with retro aesthetics, improved background, and personal tweaks.β13Dec 4, 2025Updated 11 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer β’ AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A sub-1KB, self-hosting, native code Forth without compromiseβ11May 4, 2026Updated 6 months ago
- HussariX - software to open/ read and view Cameca EPMA and Bruker SEM formats, track samples in ΞΌ-space and time.β10May 5, 2023Updated 3 years ago
- AI-powered computer automation framework using VNC, OpenAI agents, and OS-ATLAS grounding for visual task executionβ17Jun 27, 2025Updated last year
- ActivityWatch watcher for mpvβ13Oct 19, 2026Updated last month
- The Lily programming language ββ11Aug 12, 2026Updated 3 months ago
- High-resolution screenshot capture plugin for IDA Proβ13May 31, 2024Updated 2 years ago
- Vulkan frame limiterβ11Jun 19, 2024Updated 2 years ago
- Odin bindings for fasm, the flat assemblerβ11Aug 20, 2026Updated 2 months ago
- Rewrite of CTime by Casey Muratori in Odinβ11Jan 30, 2020Updated 6 years ago
- AI Agents on DigitalOcean Gradient AI Platform β’ AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Open-source coding agent like Cursor/Windsurf in your browserβ18Jul 9, 2025Updated last year
- Light implementation of boxee.tv server to restore functionality to Boxee Boxesβ13Feb 22, 2026Updated 8 months ago
- Proof assistantβ13Updated this week
- A generational arena allocator for javascriptβ13Nov 13, 2020Updated 6 years ago
- AI-Powered Life Management Systemβ14Jan 13, 2025Updated last year
- Platform abstraction and utility libraryβ20Jun 12, 2026Updated 5 months ago
- β12May 16, 2020Updated 6 years ago
- β10Oct 22, 2015Updated 11 years ago
- not infinite, but huge canvas collaborative vector drawing programβ13Oct 28, 2018Updated 8 years ago
- 1-Click AI Models by DigitalOcean Gradient β’ AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Observe how the C preprocessor expands your complicated macrosβ11Aug 11, 2017Updated 9 years ago
- A curated list of awesome tools for software development, testing, and productivity published on my Twitter handle.β13Aug 13, 2024Updated 2 years ago
- AMD FEMFX Plugin for Unreal Engine 5.3β12May 18, 2025Updated last year
- moderngpu algorithms for C++ shadersβ16Mar 3, 2021Updated 5 years ago
- Twitter thread explorer made in C++/Wasm/WebGLβ12May 16, 2023Updated 3 years ago
- Streamlining Flutter UI Development with DSL-Based Code Generationβ22Jan 11, 2024Updated 2 years ago
- Embedding Lua in Odinβ10Oct 5, 2026Updated last month
Are these results useful?