A high-throughput and memory-efficient inference and serving engine for LLMs
☆17Oct 9, 2026Updated this week
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ⚡ Guidance, samples, and tools for HPC workloads on AKS clusters with RDMA and InfiniBand support, including GPUDirect RDMA.☆23Sep 25, 2026Updated 2 weeks ago
- A Rails 8 LLM Starter Kit with Raix and RailsUI on Replit☆11Aug 24, 2025Updated last year
- Sequence-level 1F1B schedule for LLMs.☆37Aug 26, 2025Updated last year
- A simple GPU reservation tool for single host shared development systems☆31Aug 24, 2026Updated last month
- Quick Notebook Tutorials☆36Jul 17, 2025Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆18Feb 2, 2024Updated 2 years ago
- GPT3 Chrome Extension Starter Kit☆16Jan 16, 2023Updated 3 years ago
- 😎 Awesome List of SaaS Starter Kits and Boilerplates. Save time and skip implementing features like authentication, subscriptions, teams…☆16Oct 14, 2022Updated 4 years ago
- Presentation, Code and Notebooks used in the conference☆12Aug 1, 2023Updated 3 years ago
- An open source code of the GitHub Copilot Workspace☆15Jun 8, 2024Updated 2 years ago
- fork of ruby 1.8.7p72 with branches for various gc and thread related patches☆16Mar 27, 2009Updated 17 years ago
- Reads an Atom feed and posts its entries to Instagram (basically feed2toot, but for Instagram)☆22Dec 24, 2024Updated last year
- code pattern and instructions to deploy intelligent loan web app☆11Sep 17, 2025Updated last year
- Rails plugin with helpers to test your app using test/spec.☆17Dec 4, 2009Updated 16 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆13Jun 15, 2023Updated 3 years ago
- never use alias_method_chain, again☆19Apr 22, 2010Updated 16 years ago
- An LLM playground similar to the OpenAI API playground☆24Dec 26, 2023Updated 2 years ago
- Get OpenVPN up and running on Ubuntu, using Chef. Great way to beat geofencing!☆17Jul 27, 2009Updated 17 years ago
- rUv-Engineer - let's you describe UI using your imagination, then see it rendered live.☆14Sep 28, 2024Updated 2 years ago
- A simple C Thread pool implementation☆13Apr 10, 2020Updated 6 years ago
- ☆14Dec 15, 2025Updated 10 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆267Dec 4, 2025Updated 10 months ago
- A port of Open AI's Swarm library written in Ruby☆22Oct 14, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ocr照片识别文字,包括裁剪图片,能识别中文和英文,是现有网上资源中识别率最好的☆14Sep 20, 2016Updated 10 years ago
- ☆64Jul 21, 2024Updated 2 years ago
- Browser automation for creating new pages in WordPress☆13Jun 7, 2025Updated last year
- a simple casual graph evaluator (for experiments)☆13Jan 3, 2019Updated 7 years ago
- Active development has moved to: http://github.com/dtgit/lftwb/tree/master Social Networking platform built in Ruby on Rails - Google gr…☆23May 28, 2009Updated 17 years ago
- ☆10Aug 10, 2024Updated 2 years ago
- PCB files for the Adafruit FONA SIMCOM 3G Breakout☆15May 21, 2019Updated 7 years ago
- Source text for the Komorebi license☆25Sep 25, 2025Updated last year
- Run AuraFlow on Replicate☆14Jul 12, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- UteXt which is UX by code.. a Markdown to UI/UX editor.☆18Oct 19, 2022Updated 3 years ago
- ☆16Jul 5, 2024Updated 2 years ago
- A demo and tutorial for Council that implements a financial analyst agent.☆11Jun 21, 2024Updated 2 years ago
- ☆12Oct 22, 2019Updated 6 years ago
- The in-toto website and documentation☆16May 27, 2026Updated 4 months ago
- ☆11Feb 13, 2024Updated 2 years ago
- Agentic authentication including SSO examples for all major frameworks☆17Jul 15, 2026Updated 2 months ago