A high-throughput and memory-efficient inference and serving engine for LLMs
☆17Sep 3, 2026Updated this week
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ⚡ Guidance, samples, and tools for HPC workloads on AKS clusters with RDMA and InfiniBand support, including GPUDirect RDMA.☆23Updated this week
- Intel Gaudi's Megatron DeepSpeed Large Language Models for training☆18Dec 19, 2024Updated last year
- GPT3 Chrome Extension Starter Kit☆16Jan 16, 2023Updated 3 years ago
- AWS Neuron Deep Learning Containers (DLCs) are a set of Docker images for training and serving models on AWS Trainium and Inferentia inst…☆23Aug 18, 2026Updated 2 weeks ago
- 😎 Awesome List of SaaS Starter Kits and Boilerplates. Save time and skip implementing features like authentication, subscriptions, teams…☆16Oct 14, 2022Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Dashboard for InferenceX™, Open Source Continuous Inference | InferenceX 仪表板☆43Updated this week
- Presentation, Code and Notebooks used in the conference☆12Aug 1, 2023Updated 3 years ago
- A collection of useful working GPTs☆12Nov 19, 2023Updated 2 years ago
- fork of ruby 1.8.7p72 with branches for various gc and thread related patches☆16Mar 27, 2009Updated 17 years ago
- Reads an Atom feed and posts its entries to Instagram (basically feed2toot, but for Instagram)☆22Dec 24, 2024Updated last year
- Rails plugin with helpers to test your app using test/spec.☆17Dec 4, 2009Updated 16 years ago
- This is a quick little utility to take some of the pain out of stitching together graphics for use as css-sprites it was conceived to fit…☆20Aug 22, 2008Updated 18 years ago
- rUv-Engineer - let's you describe UI using your imagination, then see it rendered live.☆14Sep 28, 2024Updated last year
- Native MRI callback☆19Oct 7, 2009Updated 16 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆14Dec 15, 2025Updated 8 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆267Dec 4, 2025Updated 9 months ago
- Large Language Model Text Generation Inference on Habana Gaudi☆34Mar 20, 2025Updated last year
- A port of Open AI's Swarm library written in Ruby☆22Oct 14, 2024Updated last year
- Multi-user password-store☆20Jun 5, 2024Updated 2 years ago
- ☆63Jul 21, 2024Updated 2 years ago
- An LLM-based Multi-Agent Framework for Financial Crime & Suspicious Matter Reporting☆13Apr 28, 2024Updated 2 years ago
- Python library for working with SEC Edgar☆11Apr 4, 2024Updated 2 years ago
- a simple casual graph evaluator (for experiments)☆13Jan 3, 2019Updated 7 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Active development has moved to: http://github.com/dtgit/lftwb/tree/master Social Networking platform built in Ruby on Rails - Google gr…☆23May 28, 2009Updated 17 years ago
- Wave Partial Differential Equation Solver in Python☆15Jun 5, 2024Updated 2 years ago
- 微信编辑器☆15May 8, 2015Updated 11 years ago
- ☆16Jul 5, 2024Updated 2 years ago
- A demo and tutorial for Council that implements a financial analyst agent.☆11Jun 21, 2024Updated 2 years ago
- Community maintained hardware plugin for vLLM on AWS Neuron☆50Aug 17, 2026Updated 2 weeks ago
- ☆12Oct 22, 2019Updated 6 years ago
- Hop3 - Open source platform as a service: deploy and manage your applications seamlessly☆15Updated this week
- The in-toto website and documentation☆16May 27, 2026Updated 3 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆11Feb 13, 2024Updated 2 years ago
- DRAM/SSD hybrid caching system☆15Mar 13, 2025Updated last year
- Agentic authentication including SSO examples for all major frameworks☆16Jul 15, 2026Updated last month
- An LLM inference engine, written in C++☆20Mar 30, 2026Updated 5 months ago
- Airline AI Agent with Langflow and DataStax Astra☆12Jan 14, 2025Updated last year
- Using this New Customers Can Open New account by Submitting their Documents , signature , fill up form etc. then Customer can make video…☆12Mar 2, 2024Updated 2 years ago
- ParallelWaveGAN adaptation for Mozilla TTS☆15May 23, 2020Updated 6 years ago