A high-throughput and memory-efficient inference and serving engine for LLMs
☆13Apr 14, 2026Updated 6 months ago
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- vLLM fork with Marlin W4A8 SM121 patches + TMA module☆15Mar 23, 2026Updated 7 months ago
- Testing node.js or io.js app with wallaby.js☆10Oct 13, 2017Updated 9 years ago
- ☆16Oct 16, 2026Updated last week
- iSCSI target for microcontrollers (ESP32/Teensy4.1/RP2040W), Linux, *BSD and Microsoft Windows☆11Apr 21, 2026Updated 6 months ago
- Terminal system monitor (TUI) that builds its layout from the hardware it actually finds — hybrid CPU clusters, GPUs, RDMA/RoCE NICs, PCI…☆17Aug 1, 2026Updated 2 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Run local LLMs on a Tesla V100-SXM2-16GB: prebuilt binaries, serve scripts, and setup for Windows and Linux (Qwen3 + Gemma 4, Claude Code…☆17Sep 1, 2026Updated last month
- FlashQLA TileLang GDN kernels ported to NVIDIA Blackwell consumer (GB10 / DGX Spark)☆18Jun 5, 2026Updated 4 months ago
- epever solar charger modbus esp-idf esp32☆12Apr 11, 2020Updated 6 years ago
- ☆11Dec 22, 2019Updated 6 years ago
- One script to install, run, update, and maintain ComfyUI on the NVIDIA DGX Spark (GB10 Grace Blackwell).☆79Updated this week
- DGX Spark research and tests - containers, benchmarks, and investigation notes for running models on GB10 (SM 12.1)☆28Updated this week
- A dedicated effort to make an optimized, bleeding edge vLLM image using Docker to support DGX comprehensively☆128Feb 22, 2026Updated 8 months ago
- DGX Spark inference dashboard — vLLM, SGLang, llama.cpp, WebGPU & sparkrun with agent-powered Auto-Fix and speed optimization☆69Updated this week
- GLM-5.3-Flash NVFP4 (lab quant) on 2x DGX Spark — TP=2 over RoCE, one .env, compose head/worker, download/start/stop/status/tail-log☆11Sep 8, 2026Updated last month
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Qwen3.5-122B-A10B on a DGX Spark with DFlash speculative decode. One-shot Docker/vLLM installer. 80+ tok/s!☆59Jun 29, 2026Updated 3 months ago
- Agnost GitOps Helm charts☆13Dec 9, 2025Updated 10 months ago
- Distillation pipeline from pretrained Transformers to customized FLA models☆13Aug 4, 2025Updated last year
- Web UI for sparkrun — launch and monitor inference workloads on NVIDIA DGX Spark☆28Jun 16, 2026Updated 4 months ago
- AMD PACE is a PyTorch extension for high-performance LLM inference on AMD CPUs. It provides a framework to develop and test novel optimiz…☆16Updated this week
- Tesla K80 Compatible Ollama Fork☆23Oct 13, 2026Updated 2 weeks ago
- This site has a lot of security breaches to exploit. Do not install on production environments!☆12Aug 9, 2024Updated 2 years ago
- profile based rsync-time-backup wrapper☆41Feb 28, 2019Updated 7 years ago
- LLM Engine for DGX Spark☆25Oct 13, 2026Updated 2 weeks ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Automate AWS lambda functions migration across account using CloudFormation☆11Apr 24, 2020Updated 6 years ago
- Tries to UI development. Clone of https://www.perplexity.ai/☆11Sep 30, 2023Updated 3 years ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆16Jul 31, 2026Updated 2 months ago
- The category map for agent credential management. Products, integrations, recipes, patterns, threat models. Curated by Authsome.☆12Jun 2, 2026Updated 4 months ago
- vLLM Tune consolidates MoE and FP8 dense GEMM kernel tuning into a single command☆32May 24, 2026Updated 5 months ago
- Simple plain-text editor for OS X with multiple useful features.☆50Oct 12, 2017Updated 9 years ago
- ☆14Sep 4, 2024Updated 2 years ago
- It's a hack to disable the compatibilty check of some synology devices☆34Apr 20, 2025Updated last year
- A taste-first UI design skill for coding agents: explore visual direction through references, translate taste into executable design docs…☆23May 2, 2026Updated 5 months ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- ☆75Feb 27, 2026Updated 8 months ago
- Working recipe: MiniMax-M3 NVFP4 at tensor-parallel 3 across 3x DGX Spark (GB10/sm_121) with clean tool-calling. Includes the head-node O…☆16Jul 13, 2026Updated 3 months ago
- Kubeconfig Generator is a tool to generate kubeconfig.☆12Jun 28, 2019Updated 7 years ago
- ☆27Sep 13, 2026Updated last month
- SingleCell: A Python/Cython Package for Processing Single-Cell RNA-Seq Data.☆11Jan 26, 2018Updated 8 years ago
- Rust-host continuation of DwarfStar for explicit, hardware-validated large-model inference on DGX-Spark.☆18Updated this week
- Tiger cryptographic hash function for Go☆12May 24, 2017Updated 9 years ago