A high-throughput and memory-efficient inference and serving engine for LLMs
☆16Jul 31, 2026Updated 3 months ago
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆16Jun 27, 2026Updated 4 months ago
- FlashQLA TileLang GDN kernels ported to NVIDIA Blackwell consumer (GB10 / DGX Spark)☆18Jun 5, 2026Updated 5 months ago
- Archived fork of antirez/ds4 for GB10 DSpark — continues as Athena: github.com/xangel82/Athena-Engine☆28Oct 30, 2026Updated 2 weeks ago
- Repository for the netperf component used by the Network-Aware framework for the Kubernetes platform based the Scheduler Framework☆10Dec 9, 2021Updated 4 years ago
- Optimized inference for the DGX Spark and spark clusters☆142Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- MCP server that delegates Claude Code agent work to local models (llama.cpp / vLLM) on your own hardware☆19Nov 2, 2026Updated 2 weeks ago
- Codes for 'Stationary Activations for Uncertainty Calibration in Deep Learning' (NeurIPS 2020)☆12Oct 20, 2020Updated 6 years ago
- 詳説ディープラーニング(生成モデル編)☆11May 15, 2019Updated 7 years ago
- Repository for out-of-tree scheduler plugins based on scheduler framework.☆11Jul 4, 2026Updated 4 months ago
- ☆21Apr 7, 2026Updated 7 months ago
- DiT (training + flow matching) in Jax☆12Jan 5, 2025Updated last year
- docker for UTH-BERT: https://ai-health.m.u-tokyo.ac.jp/uth-bert☆14Mar 24, 2023Updated 3 years ago
- Pinned one-DGX-Spark Docker recipe for DeepSeek V4 Flash with EXL3, SparkInfer, and 262K NVFP4 MLA KV cache☆31Sep 6, 2026Updated 2 months ago
- 京大工学部電気電子工学科の卒論をマークダウンで書くための一式☆12Jan 13, 2021Updated 5 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Text-to-video generation.☆10Jul 22, 2022Updated 4 years ago
- Reboot-proof tmux: every session, layout and scrollback comes back, and Claude Code, Codex, Gemini CLI, opencode and pi reopen the conver…☆83Updated this week
- SFC controller: extension to the default scheduler (Kube-Scheduler) in Kubernetes to enable scheduling in terms of latency and bandwidth☆18Jul 3, 2020Updated 6 years ago
- Switchless RoCE collectives, NCCL profiles and fabric tooling for DGX Spark inference recipes☆43Nov 8, 2026Updated last week
- TailwindCSS colors for SwiftUI.☆27Aug 18, 2020Updated 6 years ago
- ☆10Jun 18, 2024Updated 2 years ago
- ☆13May 5, 2026Updated 6 months ago
- Red Hat Certified optional operator for secondary schedulers☆22Updated this week
- This Python bot automates trading on Polymarket by comparing interest rate probabilities from the bond market and Polymarket. It detects …☆12Jan 19, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- JUMAN++とKNPをDockerで使えるようにする。☆17Jan 19, 2019Updated 7 years ago
- ☆18Oct 6, 2022Updated 4 years ago
- ☆10Aug 22, 2019Updated 7 years ago
- ☆21Sep 9, 2024Updated 2 years ago
- Make it easier to rotate multiple API keys for the same API.☆14Mar 29, 2025Updated last year
- service that streams from locast to tvheadend☆14Sep 27, 2021Updated 5 years ago
- Adds a /-/mcp MCP server to any Datasette instance☆20Oct 22, 2026Updated 3 weeks ago
- Example Herdr layouts. Not official: take them apart.☆20Nov 1, 2026Updated 2 weeks ago
- Reverse proxy for OpenAI-compatible APIs, written in Rust. Rotates across multiple keys automatically, handles rate limits and failover, …☆12Oct 23, 2025Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- MCP server that lets AI agents search, retrieve, store, view, measure and de-identify DICOM images over both DIMSE and DICOMweb, using on…☆25Nov 6, 2026Updated last week
- Local AI implementation of Large-scale online deanonymization with LLMs☆13Feb 26, 2026Updated 8 months ago
- Official Implementation For PolarQuant☆47Apr 2, 2026Updated 7 months ago
- applications of https://github.com/PrefectHQ/marvin☆13Jan 15, 2024Updated 2 years ago
- This program also does sentiment analysis on IMDB movie reviews, but the reviews are first preprocessed with gensim's Doc2Vec that takes …☆10Aug 23, 2017Updated 9 years ago
- Device-agnostic web bench for Feetech servo characterization and configuration☆18Oct 25, 2026Updated 3 weeks ago
- ☆24Jul 31, 2023Updated 3 years ago
Are these results useful?