A high-throughput and memory-efficient inference and serving engine for LLMs
☆43Apr 10, 2026Updated this week
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆25Apr 7, 2026Updated last week
- Multiple GEMM operators are constructed with cutlass to support LLM inference.☆20Aug 3, 2025Updated 8 months ago
- backend wrapper for memU☆46Mar 19, 2026Updated 3 weeks ago
- Large language models designed for formal theorem proving through tool-integrated reasoning.☆33Aug 13, 2025Updated 8 months ago
- Accelerate LLM preference tuning via prefix sharing with a single line of code☆51Jul 4, 2025Updated 9 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆11Jun 28, 2024Updated last year
- Unofficial implementation of DreamTalk in ComfyUI☆12Aug 15, 2024Updated last year
- Using Demucs in comfyUI， make Music Source Separation☆10Dec 12, 2025Updated 4 months ago
- Open VLC and Pot Player links directly from your web browser.☆12May 19, 2025Updated 10 months ago
- Service for quickly aliasing and redirecting to long URLs☆25Apr 26, 2023Updated 2 years ago
- A flash implementation of hash join in C++☆31Sep 15, 2025Updated 6 months ago
- A CustomNet node for ComfyUI☆10Aug 11, 2024Updated last year
- Latent Space Sound Design Tool based on the VAE of stable-audio-open☆15Aug 23, 2024Updated last year
- Fast and memory-efficient exact attention☆20Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- [ACL 2025] An official pytorch implement of the paper: Condor: Enhance LLM Alignment with Knowledge-Driven Data Synthesis and Refinement☆39May 28, 2025Updated 10 months ago
- SGLang Kernel Wheel Index☆20Updated this week
- ☆15May 17, 2024Updated last year
- Depict GPU memory footprint during DNN training of PyTorch☆11Nov 17, 2022Updated 3 years ago
- Persistent dense gemm for Hopper in `CuTeDSL`☆15Aug 9, 2025Updated 8 months ago
- ☆11Aug 22, 2023Updated 2 years ago
- Benchmark tests supporting the TiledCUDA library.☆18Nov 19, 2024Updated last year
- An open source community implementation of the model MELLE from the paper: "Autoregressive Speech Synthesis without Vector Quantization"☆14Apr 6, 2026Updated last week
- ☆12Mar 13, 2023Updated 3 years ago
- Serverless GPU API endpoints on Runpod - Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆11May 13, 2024Updated last year
- Information about the CodedotAI reading group sessions.☆12Aug 16, 2021Updated 4 years ago
- a simple API to use CUPTI☆10Aug 19, 2025Updated 7 months ago
- A simple way to generate sound effects for stock videos using AI.☆17Mar 21, 2024Updated 2 years ago
- A toolkit for developers to simplify the transformation of nn.Module instances. It's now corresponding to Pytorch.fx.☆13Apr 7, 2023Updated 3 years ago
- ☆11Apr 5, 2021Updated 5 years ago
- vLLM performance dashboard☆44Apr 26, 2024Updated last year
- DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling☆22Mar 25, 2026Updated 2 weeks ago
- cutile kernel examples☆45Apr 3, 2026Updated last week
- Wordpress hosting with auto-scaling - Free Trial • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- This is a very simple python app that you can use to get up and chatting with Stable LM by Stability AI models locally.☆16Apr 25, 2023Updated 2 years ago
- A TypeScript Attester using Turnstile for the Privacy Pass Authentication Protocol☆14Apr 4, 2026Updated last week
- This repo holds the research projects of our lab.☆11Jan 20, 2024Updated 2 years ago
- A bookshelf plugin which handles relationships.☆22Updated this week
- KV cache compression for high-throughput LLM inference☆155Feb 5, 2025Updated last year
- Coder Desktop application for Windows☆24Feb 24, 2026Updated last month
- ☆17May 10, 2024Updated last year