A high-throughput and memory-efficient inference and serving engine for LLMs
☆33Sep 18, 2026Updated 2 months ago
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Transform unstructured documents into actionable, structured data with enterprise-grade precision and reliability, ready for large-scale …☆22Oct 13, 2025Updated last year
- ☆10Mar 24, 2024Updated 2 years ago
- ☆21Apr 13, 2022Updated 4 years ago
- Handy tools & graphics API abstraction for blazing fast prototyping☆10Jan 17, 2024Updated 2 years ago
- Tengine 管子是用来快速生产 demo 的辅助工具☆11Jul 15, 2021Updated 5 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- General-purpose implementations of ERC-792 Arbitrables.☆14Jun 21, 2024Updated 2 years ago
- ☆12Apr 19, 2022Updated 4 years ago
- java swing ui design☆10Jul 14, 2021Updated 5 years ago
- ☆11May 6, 2026Updated 6 months ago
- Awesome Resources about MegEngine☆16Mar 2, 2023Updated 3 years ago
- An Android Application for GLCC☆11Sep 30, 2022Updated 4 years ago
- Pool your ETH to save gas fees on creating PIES.☆12Jan 14, 2021Updated 5 years ago
- ☆14Jul 18, 2020Updated 6 years ago
- ☆14Apr 15, 2022Updated 4 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- SCOPE ICLR 2025☆23Oct 3, 2025Updated last year
- ☆11Dec 30, 2025Updated 10 months ago
- Farm your $SUSHI easily☆11Sep 1, 2020Updated 6 years ago
- Mozilla Verbatim - for translating Mozilla web projects - Pootle plus some Mozilla sugar☆10Sep 9, 2014Updated 12 years ago
- Collection Of All Python Notebooks Shared On Twitter☆11Apr 10, 2023Updated 3 years ago
- A handy local disk based cache for hot content from remote storage.☆15Aug 4, 2023Updated 3 years ago
- The Aurorachain project has three phases, this is the first phase of the code.☆21Sep 12, 2025Updated last year
- Kimi Code CLI skill: 定时保活维持会话 prompt 缓存,降低输入成本☆19Oct 26, 2026Updated 3 weeks ago
- Sashimi Fork Experimentations☆11Nov 11, 2020Updated 6 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- V12 GDI ready real time ECU stack☆15Jul 27, 2026Updated 3 months ago
- flask-wysiwyg provides custom form fields to render wysiwyg editor instead of regular textareas. It takes care of cleaning html for you t…☆10Jul 8, 2014Updated 12 years ago
- A simple evolutionary algorithm (Simultaneous update of all the weights)☆11Jan 10, 2023Updated 3 years ago
- 尝试作为手机助手植入到手机内运行的 ncnn llm☆17Dec 24, 2025Updated 10 months ago
- ☆20Sep 28, 2024Updated 2 years ago
- SGLang is a fast serving framework for large language models and vision language models.☆16Mar 31, 2026Updated 7 months ago
- ☆10Dec 10, 2020Updated 5 years ago
- ☆11Nov 3, 2021Updated 5 years ago
- Entry to hackmoney☆11Jan 24, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Keras implementations of Tacotron-2☆27Jan 22, 2021Updated 5 years ago
- An AI IDE secure coding MCP service☆12Nov 3, 2025Updated last year
- Decentralized Cryptocurrency Exchange for ERC20 tokens☆10Dec 10, 2022Updated 3 years ago
- CLI to remove git branches whose PR has been merged☆18Mar 5, 2026Updated 8 months ago
- Unofficial Golang SDK for Anthropic Model Context Protocol☆53Feb 1, 2025Updated last year
- ☆18Nov 30, 2022Updated 3 years ago
- A small example of an assembly bootloader☆11Jun 29, 2021Updated 5 years ago
Are these results useful?