A high-throughput and memory-efficient inference and serving engine for LLMs
☆45May 28, 2026Updated last month
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆28May 11, 2026Updated last month
- Multiple GEMM operators are constructed with cutlass to support LLM inference.☆20Aug 3, 2025Updated 11 months ago
- Text-to-Speech Benchmark☆26Apr 2, 2026Updated 3 months ago
- backend wrapper for memU☆47Mar 19, 2026Updated 3 months ago
- This is not remotely close to a finished product, and does not intend to nor does this claim to be working fine-tuning code for MaskGCT. …☆13Dec 4, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- PostHog with text analytics extensions, serving as an advanced LLM analytics platform.☆15Sep 17, 2024Updated last year
- Accelerated Computer Vision Lab (ACCV-Lab) is a systematic collection of packages with the common goal to facilitate end-to-end efficient…☆60Updated this week
- ☆26Oct 2, 2023Updated 2 years ago
- ☆10Jun 28, 2024Updated 2 years ago
- Reversed engeneered tradingview-scan api for scan cryptocurrencies (trendlines, oscillators, performance)☆17Mar 6, 2019Updated 7 years ago
- ☆13Mar 30, 2023Updated 3 years ago
- An implementation of the CLEAN algorithm for extracting individual wave packets from a multi-component signal☆16Jun 15, 2018Updated 8 years ago
- MATLAB code for Numerical Methods for Deep Learning class☆16Oct 8, 2019Updated 6 years ago
- You can using Streamv2v in ComfyUI☆12Sep 6, 2024Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- A CustomNet node for ComfyUI☆10Aug 11, 2024Updated last year
- Fast and memory-efficient exact attention☆22Jun 26, 2026Updated last week
- Service for quickly aliasing and redirecting to long URLs☆25Apr 26, 2023Updated 3 years ago
- Using Demucs in comfyUI， make Music Source Separation☆12Dec 12, 2025Updated 6 months ago
- Test-time adaptation for speech recognition model by single utterance. The official implementation of "Listen, Adapt, Better WER: Source-…☆23Apr 1, 2022Updated 4 years ago
- Implementation of Hyena Hierarchy in JAX☆10Apr 30, 2023Updated 3 years ago
- A tool to check whether Hermes products are in stock.☆10Aug 31, 2020Updated 5 years ago
- A tiny server to run local inference on MLX model in the style of OpenAI☆13Jan 31, 2024Updated 2 years ago
- ☆11Aug 22, 2023Updated 2 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Benchmark tests supporting the TiledCUDA library.☆19Nov 19, 2024Updated last year
- Automate the creation of high quality research papers in latex. Powered by Swarms 🤖☆11Dec 1, 2025Updated 7 months ago
- An open source community implementation of the model MELLE from the paper: "Autoregressive Speech Synthesis without Vector Quantization"☆16Jun 22, 2026Updated last week
- ☆12Mar 13, 2023Updated 3 years ago
- 用C++和Python实现从头实现一个深度学习训练框架☆12Nov 22, 2020Updated 5 years ago
- Information about the CodedotAI reading group sessions.☆12Aug 16, 2021Updated 4 years ago
- ComfyUI nodes to use DiLightNet☆11Oct 6, 2024Updated last year
- ☆11Apr 5, 2021Updated 5 years ago
- DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling☆29Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- This is a very simple python app that you can use to get up and chatting with Stable LM by Stability AI models locally.☆16Apr 25, 2023Updated 3 years ago
- A TypeScript Attester using Turnstile for the Privacy Pass Authentication Protocol☆15Apr 24, 2026Updated 2 months ago
- A bookshelf plugin which handles relationships.☆22Jun 26, 2026Updated last week
- ☆17May 10, 2024Updated 2 years ago
- Coder Desktop application for Windows☆24May 12, 2026Updated last month
- Stable Diffusion in TensorRT 8.5+☆15Mar 19, 2023Updated 3 years ago
- A stacked area chart with smooth interpolation. Often used to display values over time.☆21Jun 28, 2026Updated last week