A high-throughput and memory-efficient inference and serving engine for LLMs
☆18Jul 24, 2026Updated this week
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Sequence-level 1F1B schedule for LLMs.☆37Aug 26, 2025Updated 11 months ago
- Quick Notebook Tutorials☆36Jul 17, 2025Updated last year
- ☆18Feb 2, 2024Updated 2 years ago
- Create app stacks loaded with all your favourite clients, services and infra along with code boilerplates in under 5 mins.☆13Jan 19, 2023Updated 3 years ago
- Presentation, Code and Notebooks used in the conference☆11Aug 1, 2023Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Reads an Atom feed and posts its entries to Instagram (basically feed2toot, but for Instagram)☆22Dec 24, 2024Updated last year
- Tabler Rails Starter - Give your Rails app a head start with a premium, open-source dashboard template that offers a responsive and high-…☆16Nov 21, 2025Updated 8 months ago
- Rails plugin with helpers to test your app using test/spec.☆17Dec 4, 2009Updated 16 years ago
- ☆13Jun 15, 2023Updated 3 years ago
- never use alias_method_chain, again☆19Apr 22, 2010Updated 16 years ago
- An LLM playground similar to the OpenAI API playground☆24Dec 26, 2023Updated 2 years ago
- rUv-Engineer - let's you describe UI using your imagination, then see it rendered live.☆13Sep 28, 2024Updated last year
- Official implementation of ICML 2024 paper "ExCP: Extreme LLM Checkpoint Compression via Weight-Momentum Joint Shrinking".☆48Jul 12, 2024Updated 2 years ago
- This is a controller for the WE-R2.4 robot on Thingiverse.☆12Aug 19, 2019Updated 6 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A high-throughput and memory-efficient inference and serving engine for LLMs☆267Dec 4, 2025Updated 7 months ago
- An enterprise-grade AI-powered backtesting framework built on the Swarms framework for automated trading strategy validation and optimiza…☆15Oct 13, 2025Updated 9 months ago
- A port of Open AI's Swarm library written in Ruby☆22Oct 14, 2024Updated last year
- ☆63Jul 21, 2024Updated 2 years ago
- ☆24Nov 17, 2016Updated 9 years ago
- Python library for working with SEC Edgar☆11Apr 4, 2024Updated 2 years ago
- a simple casual graph evaluator (for experiments)☆13Jan 3, 2019Updated 7 years ago
- Active development has moved to: http://github.com/dtgit/lftwb/tree/master Social Networking platform built in Ruby on Rails - Google gr…☆23May 28, 2009Updated 17 years ago
- ☆10Aug 10, 2024Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Source text for the Komorebi license☆25Sep 25, 2025Updated 10 months ago
- Run AuraFlow on Replicate☆14Jul 12, 2024Updated 2 years ago
- go binding for rdma rsocket☆23Nov 30, 2024Updated last year
- UteXt which is UX by code.. a Markdown to UI/UX editor.☆18Oct 19, 2022Updated 3 years ago
- Wave Partial Differential Equation Solver in Python☆15Jun 5, 2024Updated 2 years ago
- ☆15Jul 5, 2024Updated 2 years ago
- A demo and tutorial for Council that implements a financial analyst agent.☆11Jun 21, 2024Updated 2 years ago
- Community maintained hardware plugin for vLLM on AWS Neuron☆46Updated this week
- Hop3 - Open source platform as a service: deploy and manage your applications seamlessly☆15Jul 16, 2026Updated last week
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆11Feb 13, 2024Updated 2 years ago
- Agentic authentication including SSO examples for all major frameworks☆16Jul 15, 2026Updated last week
- Official implementation of Beyond the Heatmap: A Rigorous Evaluation of Component Impact in MCTS-Based TSP Solvers.☆13Mar 1, 2026Updated 4 months ago
- An LLM inference engine, written in C++☆20Mar 30, 2026Updated 3 months ago
- Airline AI Agent with Langflow and DataStax Astra☆12Jan 14, 2025Updated last year
- Using this New Customers Can Open New account by Submitting their Documents , signature , fill up form etc. then Customer can make video…☆12Mar 2, 2024Updated 2 years ago
- RailsUrlShortener is a lightweight Rails engine for short URLs. Ip logger capabilities too.☆20Oct 20, 2025Updated 9 months ago