A high-throughput and memory-efficient inference and serving engine for LLMs
☆41Oct 15, 2026Updated this week
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Native DeepSeek V4.1 Flash inference across one RTX PRO 6000 and four DGX Spark expert workers☆35Sep 25, 2026Updated 3 weeks ago
- Serve EXL3 (ExLlamaV3 trellis) quantized models on vLLM fork runtimes — any architecture, mixed per-layer bitrates, composable with sourc…☆26Updated this week
- GLM-5.2-Int4-Int8 on 8x GB10 cluster☆39Jul 30, 2026Updated 2 months ago
- ☆14Jul 22, 2025Updated last year
- Optimized cross-platform expansion of autoresearch.☆18Mar 23, 2026Updated 6 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Serve the official Ling-3.0-flash INT4 on one NVIDIA DGX Spark, 38.7 tok/s, faster than the community GGUF. Recipe, watchdog, benchmarks.☆26Aug 29, 2026Updated last month
- Fast, capable GLM-5.3-Flash FP4-Local on two DGX Sparks: opinionated Atlas serving and reproducible inference research.☆63Updated this week
- DGX Spark (GB10) random hard power-off: how to diagnose the log-less crash signature and stop it with a GPU clock cap. Field-tested fix +…☆25Aug 16, 2026Updated 2 months ago
- ☆41Aug 16, 2026Updated 2 months ago
- vLLM inference solutions for NVIDIA GB10 (DGX Spark, sm121) — KIMI-K3 B12X_MLA + DSpark, GLM-5.2☆67Sep 30, 2026Updated 2 weeks ago
- qwen38-flash-next recipe for tp=2 GB10☆127Oct 6, 2026Updated last week
- GLM-5.3-Flash (NVFP4) at TP=4 across 4x ASUS GX10 / GB10 - vLLM + mentat instead of Ray, 524k context, DFlash2. Minimal working recipe.☆88Updated this week
- Full GLM-5.3 (753B, Int4-Int8Mix) on 4x NVIDIA DGX Spark, vLLM TP4☆23Updated this week
- Minimal read-only OS image for GB10 (DGX Spark / ASUS GX10) boxes☆89Oct 4, 2026Updated 2 weeks ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Mata Kuliah Web Programming - Frontend menggunakan ReactJS☆11Sep 9, 2024Updated 2 years ago
- Lightweight yet full-featured, highly-extensible charting platform.☆15Sep 9, 2026Updated last month
- Archived: b12x development has moved to FlashInfer. See README for migration and PR-porting guidance.☆268Oct 6, 2026Updated last week
- Hermes ↔ Grok Bot bridge: SSH relay and native API (:8642) methods☆27Sep 16, 2026Updated last month
- Disaggregated quantization official codebase☆28Updated this week
- NVIDIA NeMo Fabric☆52Updated this week
- Wrap commands that might cause out-of-memory errors, and stop them before they freeze your machine☆15Sep 22, 2026Updated 3 weeks ago
- GLM-5.3-Flash NVFP4 on 4x NVIDIA DGX Spark: vLLM TP4, DFlash2 adaptive draft, measured FP8 vs NVFP4 vs EXL3 vs SGLang☆37Sep 29, 2026Updated 2 weeks ago
- AGI runtime for bounded recursive self-awareness. Attempting machine consciousness at the Gödel–Turing–Hofstadter Nexus.☆17Oct 5, 2026Updated 2 weeks ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- The "PlexURLGen" is a Python script designed to rapidly generate direct links for Plex media.☆12Sep 29, 2023Updated 3 years ago
- BertholomusAI recipe: DeepSeek-V4.1-Flash on 2x NVIDIA DGX Spark (GB10), our own TensorFold TP2 engine. Weights: Mia-AiLab EXL3 2.9bpw (M…☆38Updated this week
- Let's vibe hardware: create magical things by chatting with AI.☆47Jul 20, 2026Updated 2 months ago
- Ensure that devise will update a flag/timestamp on the model whenever a user is authenticated.☆14Nov 12, 2025Updated 11 months ago
- Use your OAuth subscriptions or API keys in any coding agent, Factory Droid, Cursor, and more. Tunnel Agent handles provider authenticati…☆36Updated this week
- GLM-5.3-Flash on 4× NVIDIA CMP 170HX with vLLM: up to 482.6 tok/s single-user, up to 943.7 tok/s at 8 users, 262K context, TP4 or PP4, on…☆77Updated this week
- ☆13Jan 16, 2024Updated 2 years ago
- A fully automated leaderboard for Pokémon Go trainers☆11Apr 12, 2025Updated last year
- LLM inference decode throughput benchmark with Rich TUI dashboard. Measures token generation speed across concurrency levels and context …☆119Updated this week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Dockerized Screaming Frog SEO Spider☆13May 22, 2023Updated 3 years ago
- We gave AI models telepathy.☆18Sep 25, 2026Updated 3 weeks ago
- GLM-5.3-Flash EXL3 (320B MoE) on 2x NVIDIA DGX Spark — production serving kit, 1M context, 97%+ multi-session prefix caching, DFlash2 spe…☆62Oct 5, 2026Updated 2 weeks ago
- A plugin marketplace for GeoLibre☆35Oct 12, 2026Updated last week
- 一个用于GitLab/GitHub或通用代码托管平台的自动化代码审查工具，旨在提升代码质量，提供智能反馈，并通过灵活配置实现高效的审查流程。☆15Mar 28, 2025Updated last year
- Using OCR and pytesseract to extract links from images in Python☆15Dec 23, 2018Updated 7 years ago
- Local diagnostic CLI for NVIDIA DGX Spark (GB10). Detects power caps, UMA pressure, thermal risk, CUDA 13/SM_121 wheel mismatches, Docker…☆162Oct 4, 2026Updated 2 weeks ago