A high-throughput and memory-efficient inference and serving engine for LLMs
☆17Aug 12, 2026Updated this week
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ⚡ Guidance, samples, and tools for HPC workloads on AKS clusters with RDMA and InfiniBand support, including GPUDirect RDMA.☆23Updated this week
- Quick Notebook Tutorials☆36Jul 17, 2025Updated last year
- ☆18Feb 2, 2024Updated 2 years ago
- GPT3 Chrome Extension Starter Kit☆16Jan 16, 2023Updated 3 years ago
- Create app stacks loaded with all your favourite clients, services and infra along with code boilerplates in under 5 mins.☆13Jan 19, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Presentation, Code and Notebooks used in the conference☆11Aug 1, 2023Updated 3 years ago
- A collection of useful working GPTs☆12Nov 19, 2023Updated 2 years ago
- An open source code of the GitHub Copilot Workspace☆14Jun 8, 2024Updated 2 years ago
- Reads an Atom feed and posts its entries to Instagram (basically feed2toot, but for Instagram)☆22Dec 24, 2024Updated last year
- Rails plugin with helpers to test your app using test/spec.☆17Dec 4, 2009Updated 16 years ago
- ☆13Jun 15, 2023Updated 3 years ago
- Pack a Ruby application into an executable jar file☆12Apr 8, 2026Updated 4 months ago
- ActiveSMS Gem fork with more gateways and email option.☆16Sep 9, 2008Updated 17 years ago
- This is a quick little utility to take some of the pain out of stitching together graphics for use as css-sprites it was conceived to fit…☆20Aug 22, 2008Updated 17 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- An LLM playground similar to the OpenAI API playground☆24Dec 26, 2023Updated 2 years ago
- Get OpenVPN up and running on Ubuntu, using Chef. Great way to beat geofencing!☆17Jul 27, 2009Updated 17 years ago
- rUv-Engineer - let's you describe UI using your imagination, then see it rendered live.☆14Sep 28, 2024Updated last year
- Native MRI callback☆19Oct 7, 2009Updated 16 years ago
- ☆14Dec 15, 2025Updated 8 months ago
- This is a controller for the WE-R2.4 robot on Thingiverse.☆12Aug 19, 2019Updated 6 years ago
- An enterprise-grade AI-powered backtesting framework built on the Swarms framework for automated trading strategy validation and optimiza…☆15Oct 13, 2025Updated 10 months ago
- Multi-user password-store☆20Jun 5, 2024Updated 2 years ago
- ☆24Nov 17, 2016Updated 9 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Browser automation for creating new pages in WordPress☆13Jun 7, 2025Updated last year
- Python library for working with SEC Edgar☆11Apr 4, 2024Updated 2 years ago
- a simple casual graph evaluator (for experiments)☆13Jan 3, 2019Updated 7 years ago
- Active development has moved to: http://github.com/dtgit/lftwb/tree/master Social Networking platform built in Ruby on Rails - Google gr…☆23May 28, 2009Updated 17 years ago
- ☆10Aug 10, 2024Updated 2 years ago
- A locally trained model of Stoney Nakoda has been developed and released. You can access the working model here or train your own instanc…☆10Updated this week
- Source text for the Komorebi license☆25Sep 25, 2025Updated 10 months ago
- Run AuraFlow on Replicate☆14Jul 12, 2024Updated 2 years ago
- A demo and tutorial for Council that implements a financial analyst agent.☆11Jun 21, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Code samples supporting an XMPP talk I have given.☆18Sep 26, 2008Updated 17 years ago
- ☆12Oct 22, 2019Updated 6 years ago
- ejabberd module implementing a microblogging service☆17Sep 18, 2008Updated 17 years ago
- The in-toto website and documentation☆16May 27, 2026Updated 2 months ago
- ☆11Feb 13, 2024Updated 2 years ago
- Agentic authentication including SSO examples for all major frameworks☆16Jul 15, 2026Updated 3 weeks ago
- Official implementation of Beyond the Heatmap: A Rigorous Evaluation of Component Impact in MCTS-Based TSP Solvers.☆13Mar 1, 2026Updated 5 months ago