A high-throughput and memory-efficient inference and serving engine for LLMs
☆17Jun 12, 2026Updated this week
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A Rails 8 LLM Starter Kit with Raix and RailsUI on Replit☆11Aug 24, 2025Updated 9 months ago
- GPT3 Chrome Extension Starter Kit☆16Jan 16, 2023Updated 3 years ago
- Quick Notebook Tutorials☆36Jul 17, 2025Updated 10 months ago
- A simple and spectacular photo-tweeting birdhouse☆83Apr 30, 2014Updated 12 years ago
- A collection of free of charge learning resources from Red Hat☆39Aug 4, 2022Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A collection of useful working GPTs☆12Nov 19, 2023Updated 2 years ago
- Create app stacks loaded with all your favourite clients, services and infra along with code boilerplates in under 5 mins.☆13Jan 19, 2023Updated 3 years ago
- Tabler Rails Starter - Give your Rails app a head start with a premium, open-source dashboard template that offers a responsive and high-…☆16Nov 21, 2025Updated 6 months ago
- Pack a Ruby application into an executable jar file☆12Apr 8, 2026Updated 2 months ago
- An LLM playground similar to the OpenAI API playground☆24Dec 26, 2023Updated 2 years ago
- AI Assistant (aia) a Ruby Gem for using genAI on the CLI☆30Updated this week
- code pattern and instructions to deploy intelligent loan web app☆11Sep 17, 2025Updated 8 months ago
- ☆13Jun 15, 2023Updated 2 years ago
- rUv-Engineer - let's you describe UI using your imagination, then see it rendered live.☆13Sep 28, 2024Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A dynamic GPU memory allocator, suitable for warp synchronized scenarios.☆11Aug 20, 2019Updated 6 years ago
- ocr照片识别文字,包括裁剪图片,能识别中文和英文,是现有网上资源中识别率最好的☆14Sep 20, 2016Updated 9 years ago
- ☆13Dec 15, 2025Updated 5 months ago
- A curated list of awesome stuff built using Amazon Alexa☆23Jun 23, 2016Updated 9 years ago
- Satcom radio website☆17Jan 29, 2026Updated 4 months ago
- ☆10Aug 10, 2024Updated last year
- A locally trained model of Stoney Nakoda has been developed and released. You can access the working model here or train your own instanc…☆10May 27, 2026Updated 2 weeks ago
- a simple casual graph evaluator (for experiments)☆13Jan 3, 2019Updated 7 years ago
- Parse Networking PDU , *.pcap *.pcapng file And Networing knowledge.☆14May 20, 2022Updated 4 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- An enterprise-grade AI-powered backtesting framework built on the Swarms framework for automated trading strategy validation and optimiza…☆13Oct 13, 2025Updated 8 months ago
- go binding for rdma rsocket☆23Nov 30, 2024Updated last year
- An LLM-based Multi-Agent Framework for Financial Crime & Suspicious Matter Reporting☆13Apr 28, 2024Updated 2 years ago
- Automate indexing files and pages from SharePoint into Azure AI Search☆11Jun 6, 2024Updated 2 years ago
- A jQuery plugin for text that grows on you☆45Oct 20, 2015Updated 10 years ago
- Browser automation for creating new pages in WordPress☆13Jun 7, 2025Updated last year
- Run AuraFlow on Replicate☆14Jul 12, 2024Updated last year
- Experimental Java to Go transcompiler that converts between a Java AST to native Go code☆13Dec 7, 2025Updated 6 months ago
- A demo and tutorial for Council that implements a financial analyst agent.☆11Jun 21, 2024Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Educational tools for AI Ethics and Safety research 🛠️🔬☆28Jan 7, 2025Updated last year
- AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus o…☆18Mar 31, 2025Updated last year
- Airline AI Agent with Langflow and DataStax Astra☆12Jan 14, 2025Updated last year
- ☆12Oct 22, 2019Updated 6 years ago
- ☆11Feb 13, 2024Updated 2 years ago
- 基于redis-stream的延迟队列☆14Oct 24, 2022Updated 3 years ago
- This is a controller for the WE-R2.4 robot on Thingiverse.☆12Aug 19, 2019Updated 6 years ago