Run SGLang on 1-to-N NVIDIA DGX Spark servers (single Spark, 2 via direct cable, or 3+ via switched fabric) to serve or benchmark LLMs
☆22May 1, 2026Updated 5 months ago
Alternatives and similar repositories for sglang-dgx-spark
Users that are interested in sglang-dgx-spark are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- First Int4-Int8Mix quantization of the full GLM-5.3 (743B), served on 4x NVIDIA DGX Spark (GB10) at TP4. Quantizer, verification gates, a…☆19Oct 6, 2026Updated 3 weeks ago
- vLLM Tune consolidates MoE and FP8 dense GEMM kernel tuning into a single command☆32May 24, 2026Updated 5 months ago
- MiMo-V2.5 Omni TP=2 on 2x DGX Spark · 1M context · NVFP4 4-bit KV (~1.97M-token KV pool @ 1M, ~30 tok/s) · 69-eval: thinking-OFF 97.8 bea…☆39Jul 13, 2026Updated 3 months ago
- Sharing benchmarks from DGX stations☆28Sep 11, 2026Updated last month
- Scitrera builds of various CUDA containers for version consistency, starting primarily with NVIDIA DGX Spark Containers☆41Aug 21, 2026Updated 2 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Open-source Cantonese (HK) TTS — CPU-first ONNX inference SDK☆16Aug 1, 2026Updated 2 months ago
- A userspace tunnel between two hosts mapping ports on client machine to addresses reachable from server machine.☆18Feb 25, 2022Updated 4 years ago
- Reproducible Docker/vLLM deployment, tuning, and benchmarks for DeepSeek V4.1 Flash on a switchless three-node or four-node DGX Spark fab…☆54Updated this week
- Public documentation, privacy policy, and support pages for StackChan Pet Talk.☆13Aug 8, 2026Updated 2 months ago
- RTMP server implemented in Rust☆13Updated this week
- Working recipe: MiniMax-M3 NVFP4 at tensor-parallel 3 across 3x DGX Spark (GB10/sm_121) with clean tool-calling. Includes the head-node O…☆16Jul 13, 2026Updated 3 months ago
- Examples to inject or intercept something with JAX-RS.☆13Jun 18, 2015Updated 11 years ago
- Qwen3.8-27B NVFP4 on SGLang (DGX Spark / SM121): official image pin, native DSpark/EAGLE click-run, matched evals☆21Aug 19, 2026Updated 2 months ago
- Kinda like other 2MQTT packages but for CUPS, the UNIX printing system☆14Oct 19, 2026Updated last week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Serve Poolside Laguna S 2.1 (NVFP4) on the NVIDIA DGX Spark (GB10) without hanging your box. Working stack, crash-safe configs, benchmark…☆19Jul 22, 2026Updated 3 months ago
- Qwen3.8-27B NVFP4 (W4A16 shipped recipe) + MTP on NVIDIA DGX Spark GB10/SM121 — vLLM v0.27.2rc0, FP8 KV, 262K context, full reproducibili…☆27Aug 20, 2026Updated 2 months ago
- The Ultimate Guide to Building a Google Cloud Foundation, published by Packt☆11Jan 18, 2023Updated 3 years ago
- ☆12Jun 22, 2022Updated 4 years ago
- ☆12Feb 16, 2024Updated 2 years ago
- Golang Shlyuz Implant Implementation☆13May 23, 2025Updated last year
- Deceptive tradecraft should be fun and light, not stern and stressful. It is cool to be cute.☆13Dec 1, 2023Updated 2 years ago
- Local benchmarking UI for LLMs and AI agents☆25Apr 13, 2026Updated 6 months ago
- Docker configuration for running VLLM on dual DGX Sparks☆2,456Updated this week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Cloud SQL Proxy works with encrypted credential file.☆10Jan 27, 2021Updated 5 years ago
- ☆13Jun 16, 2026Updated 4 months ago
- Mapping tile server for Datasette, serving tiles from MBTiles packages☆11Jun 11, 2022Updated 4 years ago
- Nemo - An offensive Remote Access Tool & Post-Exploitation Framework (WIP).☆14Apr 25, 2023Updated 3 years ago
- Device overview and Getting Started with Cardputer☆24Jun 1, 2025Updated last year
- Automatically perform advanced NTLM hash relay attacks☆15Nov 4, 2022Updated 3 years ago
- An application that displays a map and graphs showing solar irradiance forecasts in solar farms in Georgia using data from the National S…☆10Oct 15, 2021Updated 5 years ago
- Rust CLI for RBMEM (.rbmem), a structured Rust-Brain memory format with timestamp-protected sections, hierarchy, graph relations, Hermes …☆28Oct 18, 2026Updated last week
- Datasette plugin adding SQL functions for fuzzy text matching powered by Jellyfish☆15Aug 24, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Guidelines on writing effective Google Cloud samples.☆13Apr 24, 2026Updated 6 months ago
- This project demonstrates an end-to-end AI-powered agriculture web app, developed using open-source agricultural data from Kaggle.☆10Sep 26, 2025Updated last year
- Automated Persistence and Lateral Movement using GCP Patch Management☆16Aug 11, 2022Updated 4 years ago
- app2run is a python CLI tool to translate App Engine configuration into compatible Cloud Run configuration, it aims to help App Engine us…☆14Jan 20, 2023Updated 3 years ago
- DSPy-native autonomous AI agent runtime — describe your goal, Arachne weaves the agent graph, executes with full observability, and evolv…☆12Sep 18, 2026Updated last month
- Contains a python script and service file for sending Zeek extracted files to Cuckoo Sandbox☆11Jun 4, 2020Updated 6 years ago
- Semantic Parser Localizer (SPL) code repository☆10Mar 15, 2021Updated 5 years ago