A high-throughput and memory-efficient inference and serving engine for LLMs
☆17Sep 24, 2026Updated this week
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆14Aug 12, 2019Updated 7 years ago
- Intel Gaudi's Megatron DeepSpeed Large Language Models for training☆18Dec 19, 2024Updated last year
- ☆14May 10, 2024Updated 2 years ago
- Evaluate how vLLM and SGLang perform when running a small LLM model on a mid-range NVIDIA GPU☆21Updated this week
- An open source code of the GitHub Copilot Workspace☆16Jun 8, 2024Updated 2 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Reads an Atom feed and posts its entries to Instagram (basically feed2toot, but for Instagram)☆22Dec 24, 2024Updated last year
- ☆13Jun 15, 2023Updated 3 years ago
- This is a quick little utility to take some of the pain out of stitching together graphics for use as css-sprites it was conceived to fit…☆19Aug 22, 2008Updated 18 years ago
- Get OpenVPN up and running on Ubuntu, using Chef. Great way to beat geofencing!☆17Jul 27, 2009Updated 17 years ago
- rUv-Engineer - let's you describe UI using your imagination, then see it rendered live.☆15Sep 28, 2024Updated last year
- Native MRI callback☆19Oct 7, 2009Updated 16 years ago
- A simple C Thread pool implementation☆13Apr 10, 2020Updated 6 years ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆267Dec 4, 2025Updated 9 months ago
- Large Language Model Text Generation Inference on Habana Gaudi☆34Mar 20, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- An enterprise-grade AI-powered backtesting framework built on the Swarms framework for automated trading strategy validation and optimiza…☆15Oct 13, 2025Updated 11 months ago
- A port of Open AI's Swarm library written in Ruby☆22Oct 14, 2024Updated last year
- ☆18Sep 7, 2023Updated 3 years ago
- Multi-user password-store☆20Jun 5, 2024Updated 2 years ago
- ☆64Jul 21, 2024Updated 2 years ago
- ☆24Nov 17, 2016Updated 9 years ago
- Browser automation for creating new pages in WordPress☆13Jun 7, 2025Updated last year
- Python library for working with SEC Edgar☆10Apr 4, 2024Updated 2 years ago
- a simple casual graph evaluator (for experiments)☆13Jan 3, 2019Updated 7 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆10Aug 10, 2024Updated 2 years ago
- Run AuraFlow on Replicate☆14Jul 12, 2024Updated 2 years ago
- Wave Partial Differential Equation Solver in Python☆15Jun 5, 2024Updated 2 years ago
- A demo and tutorial for Council that implements a financial analyst agent.☆11Jun 21, 2024Updated 2 years ago
- ☆12Oct 22, 2019Updated 6 years ago
- The in-toto website and documentation☆16May 27, 2026Updated 3 months ago
- DRAM/SSD hybrid caching system☆15Mar 13, 2025Updated last year
- Agentic authentication including SSO examples for all major frameworks☆17Jul 15, 2026Updated 2 months ago
- Airline AI Agent with Langflow and DataStax Astra☆11Jan 14, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Using this New Customers Can Open New account by Submitting their Documents , signature , fill up form etc. then Customer can make video…☆12Mar 2, 2024Updated 2 years ago
- ParallelWaveGAN adaptation for Mozilla TTS☆15May 23, 2020Updated 6 years ago
- AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus o…☆20Mar 31, 2025Updated last year
- Advanced Strawberry Logic for All LLMs☆15Sep 24, 2024Updated 2 years ago
- ☆18Apr 1, 2024Updated 2 years ago
- Lightweight and friendly .NET library for realizing modern Semantic Web applications (OWL2, SWRL, SKOS)☆17Updated this week
- Use database namespacing to run rspec Selenium tests against rails in parallel☆18Feb 9, 2010Updated 16 years ago