A high-throughput and memory-efficient inference and serving engine for LLMs
☆41Feb 2, 2026Updated last month
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below
Sorting:
- backend wrapper for memU☆35Feb 24, 2026Updated last week
- Accelerated Computer Vision Lab (ACCV-Lab) is a systematic collection of packages with the common goal to facilitate end-to-end efficient…☆45Feb 15, 2026Updated 2 weeks ago
- ☆70Feb 25, 2026Updated last week
- ☆26Oct 2, 2023Updated 2 years ago
- Service for quickly aliasing and redirecting to long URLs☆24Apr 26, 2023Updated 2 years ago
- Analyzes and visualizes personal data exports provided by the dating app Hinge.☆14Apr 25, 2025Updated 10 months ago
- [ICRA 2026] StereoAdapter: Adapting Stereo Depth Estimation to Underwater Scenes☆20Feb 17, 2026Updated 2 weeks ago
- vLLM performance dashboard☆42Apr 26, 2024Updated last year
- MiniMax-Provider-Verifier offers a rigorous, vendor-agnostic way to verify whether third-party deployments of the Minimax M2 model are co…☆29Feb 18, 2026Updated 2 weeks ago
- High performance async Mssql library for Python.☆17Feb 20, 2026Updated last week
- The best Python package for comparing two dataframes☆11Dec 29, 2021Updated 4 years ago
- Runflow is a tool to define and run workflows.☆10Jul 13, 2021Updated 4 years ago
- Datamallet is a python library which contains several helper functions and module for the common tasks in a typical data science workflow…☆11May 19, 2022Updated 3 years ago
- Accelerate LLM preference tuning via prefix sharing with a single line of code☆51Jul 4, 2025Updated 8 months ago
- PicWish T2I, Photo Enhancer and Background Remover for Python☆24Jul 6, 2025Updated 7 months ago
- DragMesh: Interactive 3D Generation Made Easy☆20Dec 28, 2025Updated 2 months ago
- A powerful integration that combines Browserbase's Stagehand with Mastra for advanced web automation, scraping, and AI-powered web intera…☆33Feb 4, 2026Updated 3 weeks ago
- Community maintained hardware plugin for vLLM on AWS Neuron☆23Updated this week
- source code☆10Dec 13, 2023Updated 2 years ago
- ☆10Oct 22, 2024Updated last year
- Embed QR codes in your emails☆12Updated this week
- [ICLR 2026] Draw-In-Mind: Rebalancing Designer-Painter Roles in Unified Multimodal Models Benefits Image Editing☆25Jan 27, 2026Updated last month
- A simple and efficient .NET library for accessing Anthropic's Claude AI API. This community-provided library allows you to easily integra…☆10Oct 10, 2024Updated last year
- a viewer for for lancedb. including some actions like CRUD etc☆12Apr 27, 2025Updated 10 months ago
- Using Demucs in comfyUI， make Music Source Separation☆10Dec 12, 2025Updated 2 months ago
- A tool for faster application development Plotly Dash☆11Nov 9, 2024Updated last year
- 若依前后端分离框架的Python实现。☆15Jun 6, 2022Updated 3 years ago
- A curated list of awesome Letta projects, tools, tutorials, and resources for building stateful AI agents with persistent memory.☆24Oct 23, 2025Updated 4 months ago
- An open source community implementation of the model MELLE from the paper: "Autoregressive Speech Synthesis without Vector Quantization"☆14Feb 23, 2026Updated last week
- UpSet intersection visualization utility for Plolty (Python-only)☆13Mar 9, 2023Updated 2 years ago
- Implementation of Hyena Hierarchy in JAX☆10Apr 30, 2023Updated 2 years ago
- Python wrapper for the Highcharts Maps data visualization library.☆13Aug 20, 2024Updated last year
- Documentation for the dash-extensions library☆11Aug 6, 2025Updated 6 months ago
- Apple Pay and Google Pay in a single install. Digital Wallet Payment Orchestration built on a Serverless Stack for AWS using Golang, Node…☆12Oct 12, 2021Updated 4 years ago
- ⚡ An optimized,Next for AiNiee powered by UV. Features intelligent format conversion, multi-profile config system, and stabilized TUI. ⚡ …☆28Feb 25, 2026Updated last week
- Transactional Machine Learning using Data Streams and AutoML☆14Oct 5, 2025Updated 4 months ago
- a simple API to use CUPTI☆11Aug 19, 2025Updated 6 months ago
- A FastAPI app that authenticates users via LDAP for nginx☆12Feb 21, 2026Updated last week
- This is not remotely close to a finished product, and does not intend to nor does this claim to be working fine-tuning code for MaskGCT. …☆13Dec 4, 2024Updated last year