A high-throughput and memory-efficient inference and serving engine for LLMs
☆16Jul 31, 2026Updated 2 months ago
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆18May 31, 2026Updated 4 months ago
- FlashQLA TileLang GDN kernels ported to NVIDIA Blackwell consumer (GB10 / DGX Spark)☆18Jun 5, 2026Updated 4 months ago
- vLLM fork with Marlin W4A8 SM121 patches + TMA module☆15Mar 23, 2026Updated 7 months ago
- vLLM Tune consolidates MoE and FP8 dense GEMM kernel tuning into a single command☆32May 24, 2026Updated 5 months ago
- Optimized inference for the DGX Spark and spark clusters☆130Updated this week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- MCP server that delegates Claude Code agent work to local models (llama.cpp / vLLM) on your own hardware☆13Oct 12, 2026Updated 2 weeks ago
- Docker compose configs for serving Qwen3.8-27B on a DGX Spark (GB10): vLLM+MTP current, SGLang+DSPARK + FP8 rollback stacks☆13Updated this week
- ☆22Aug 10, 2026Updated 2 months ago
- Repository for the netperf component used by the Network-Aware framework for the Kubernetes platform based the Scheduler Framework☆10Dec 9, 2021Updated 4 years ago
- Augmented Dickey-Fuller implementation in Go☆12Mar 15, 2019Updated 7 years ago
- Qwen 3.8 Flash NVFP4 with PLE NVFP4 quantized to run on a single DGX Spark☆15Aug 28, 2026Updated 2 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆13Apr 14, 2026Updated 6 months ago
- [DEPRECATED] Prometheus exporter for VPA recommendations☆12Aug 22, 2023Updated 3 years ago
- A fork which adds a UI to the original deep-research tool☆11Feb 8, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- GLM-5.3-Flash NVFP4 (lab quant) on 2x DGX Spark — TP=2 over RoCE, one .env, compose head/worker, download/start/stop/status/tail-log☆11Sep 8, 2026Updated last month
- Pinned one-DGX-Spark Docker recipe for DeepSeek V4 Flash with EXL3, SparkInfer, and 262K NVFP4 MLA KV cache☆32Sep 6, 2026Updated last month
- ☆21Apr 7, 2026Updated 6 months ago
- LLM Engine for DGX Spark☆25Oct 13, 2026Updated 2 weeks ago
- Repository for out-of-tree scheduler plugins based on scheduler framework.☆11Jul 4, 2026Updated 3 months ago
- DiT (training + flow matching) in Jax☆12Jan 5, 2025Updated last year
- docker for UTH-BERT: https://ai-health.m.u-tokyo.ac.jp/uth-bert☆14Mar 24, 2023Updated 3 years ago
- Repository for opt-out requests.☆18Sep 25, 2026Updated last month
- recipe for running Qwen3.8-Flash-Next on a single DGX Spark☆479Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Repo for providing the instructions to generate a new ISO or the installations scripts of DappNode☆10Oct 30, 2021Updated 4 years ago
- Code for PII detection and redaction in code datasets☆17Jan 24, 2023Updated 3 years ago
- A JS conversion/adaptation of parts of the ChatVRM (TypeScript) code for standalone use in OpenCharacters and elsewhere☆21Jul 30, 2023Updated 3 years ago
- NeuroSkill™ CLI for NodeJS☆14Jul 19, 2026Updated 3 months ago
- SFC controller: extension to the default scheduler (Kube-Scheduler) in Kubernetes to enable scheduling in terms of latency and bandwidth☆18Jul 3, 2020Updated 6 years ago
- 🦊 Ani Code is an open-source AI coding assistant designed as a Claude Code alternative, built to supercharge your workflow with automate…☆19Sep 5, 2025Updated last year
- ☆18Feb 20, 2023Updated 3 years ago
- Reverse proxy for OpenAI-compatible APIs, written in Rust. Rotates across multiple keys automatically, handles rate limits and failover, …☆12Oct 23, 2025Updated last year
- Home Assistant integration for EcoFlow energy devices: PowerOcean, PowerOcean Plus, Delta 2 Max, Delta 3, Smart Plug, Stream, Stream Micr…☆48Updated this week
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Device-agnostic web bench for Feetech servo characterization and configuration☆17Oct 18, 2026Updated last week
- ☆18Jun 19, 2023Updated 3 years ago
- ☆14Oct 5, 2026Updated 3 weeks ago
- ☆10Jun 18, 2024Updated 2 years ago
- Interactive MaleCNS fly brain atlas with native regional and neuron reconstructions☆15Sep 13, 2026Updated last month
- Recursive Language Model harness over a frozen Wikidata graph, with evaluation results☆17Oct 11, 2026Updated 2 weeks ago
- Turn your Mac into a wireless trackpad, keyboard & Stream-Deck — controlled from any phone's browser. No app install. Open source, built …☆25Aug 2, 2026Updated 2 months ago