☆19Sep 9, 2026Updated last month
Alternatives and similar repositories for vllm-starter
Users that are interested in vllm-starter are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- DGX Spark (GB10/sm_121) port: DeepSeek-V4-Flash 159B on one Spark, GLM-5.2 753B across two. Prepacked 2-bit planes + unified-memory fixes…☆19Jul 20, 2026Updated 3 months ago
- Examples for using the SiLLM framework for training and running Large Language Models (LLMs) on Apple Silicon☆16May 8, 2025Updated last year
- MiniMax-M3 (MXFP4, MSA) serving on SM120 (RTX PRO 6000 Blackwell) — patched vLLM image + launch recipe, 192K context☆22Jun 15, 2026Updated 4 months ago
- Qwen3.8-27B NVFP4 on SGLang (DGX Spark / SM121): official image pin, native DSpark/EAGLE click-run, matched evals☆21Aug 19, 2026Updated 2 months ago
- GLM-5.2 on 4x DGX Spark with adaptive MTP K2/K4/K5, FULL CUDA graphs, DCP2, 520K context, and a downloadable ARM64 runtime image.☆12Aug 8, 2026Updated 2 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Test Digital Persona U are U Fingerprint device☆10Feb 2, 2018Updated 8 years ago
- ☆21Updated this week
- CUDA Blackwell performance fork of antirez/ds4 (DeepSeek-V4-Flash): ~4x prefill, ~1.5x decode, continuous batching, weight server, DSpark☆76Sep 4, 2026Updated last month
- A UI for visualizing purely functional data structures☆11May 18, 2019Updated 7 years ago
- ☆14Jun 11, 2025Updated last year
- Make your terminal string output even more beautiful 💖☆11Jul 27, 2025Updated last year
- MiMo-V2.5 NVFP4 4-bit weights + NVFP4 4-bit KV cache + DFlash speculative decoding on 2× NVIDIA DGX Spark — 1M context, 3.4M-token KV poo…☆18Jul 13, 2026Updated 3 months ago
- Java library to enable AfterBurn with OpenFaaS☆11Mar 31, 2018Updated 8 years ago
- Okasaki's Purely Functional Data Structures in Elixir☆13May 6, 2019Updated 7 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- The 4th Coming: Next Generation Revival Project☆10Mar 29, 2017Updated 9 years ago
- 🌏 Java filesystem SPIs with Fuse (googledrive, onedrive, dropbox, box, etc...)☆11Oct 9, 2026Updated 2 weeks ago
- Production-ready vLLM deployment wrapper for Qwen3.6-27B (NVFP4) — self-hosted OpenAI-compatible inference☆60Jul 30, 2026Updated 2 months ago
- GLM-5.3-Flash (320B MoE) at TP4 across four DGX Sparks, same day as the model drop: 36 tok/s, 1.26M-token FP8 KV pool, 262K context, MTP …☆57Oct 10, 2026Updated 2 weeks ago
- ☆12Jul 24, 2019Updated 7 years ago
- Optimized VLLM for Ampere☆24Oct 18, 2026Updated last week
- Qwen 3.8 125B-A6B CUDA inference speedup benchmark: ds4 engine, overlay, and submission harness☆15Oct 10, 2026Updated 2 weeks ago
- NVIDIA Nemotron 3.5 Lightning 30B-A3B NVFP4 + DSpark for DGX Spark, RTX 5090/6000 PRO (SGLang)☆23Aug 11, 2026Updated 2 months ago
- High performance Java reflection(revised version)☆12Feb 16, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- vLLM Tune consolidates MoE and FP8 dense GEMM kernel tuning into a single command☆32May 24, 2026Updated 5 months ago
- Getting Qwen's Qwen4-architecture preview (Qwen3.8-Flash-Next) to run on a single DGX Spark GB10 — 125.9 GiB of weights against 117 GiB o…☆21Oct 14, 2026Updated last week
- A Python interpreter written in Elixir designed as an execution substrate for agents☆25Jul 7, 2026Updated 3 months ago
- Coview: The Right way to browse the web. Sends dom diffs for collaborative browsing. Blazing fast, at a fraction of bandwidth.☆19May 17, 2026Updated 5 months ago
- Uncensored Qwen3.8-27B Ultimate - BF16 master + NVFP4-MIXED deploy. QuickStarts for DGX Spark (one Dynamic DFlash lattice seat @ util 0.8…☆20Oct 6, 2026Updated 2 weeks ago
- JOCLBlast - Java bindings for CLBlast☆17Aug 22, 2026Updated 2 months ago
- Filesystem-first LLM-Wiki + Obsidian + Hermes Agent memory system. Markdown source of truth, SQLite FTS5 search, secret scanning, tier-ba…☆33May 12, 2026Updated 5 months ago
- 🖼️ AVIF Java ImageIO SPI (libavif, jna)☆19Oct 15, 2024Updated 2 years ago
- Custom inference recipes for NVIDIA DGX Spark — Qwen 122B DFlash hybrid☆90Updated this week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- MiniMax-H3 33B audio+video DiT accelerated 1.54x on a single NVIDIA DGX Spark (GB10, sm_121): NVIDIA Sol-Engine FirstBlockCache + batched…☆35Aug 17, 2026Updated 2 months ago
- A HACS repo to enable Equation Integration into Home Assistant☆12Jan 7, 2025Updated last year
- Redmine's plugin to allow to assign an SLA by issue priority and project☆11Nov 28, 2019Updated 6 years ago
- Production-quality skills, tools, and patterns for AI-powered development workflows with Claude Code☆13Jan 13, 2026Updated 9 months ago
- BH hackathon☆14Apr 4, 2024Updated 2 years ago
- Entrpi/ds4, a Blackwell CUDA perf fork of antirez/ds4 on NVIDIA DGX Spark: one-command install, ~3x upstream prefill, ~1.5x decode, DSpar…☆410Aug 27, 2026Updated last month
- DeepSeek-V4-Flash-DSpark abliterated (uncensored) · ~100% refusal bypass · C1 ~57 tok/s · 1M ctx · 2× DGX Spark · HF weights☆56Aug 17, 2026Updated 2 months ago