Self-hosted vLLM inference for Qwen3.6-35B-A3B-NVFP4
☆32Jul 11, 2026Updated 3 months ago
Alternatives and similar repositories for Qwen3.6-35B-A3B-NVFP4-vLLM
Users that are interested in Qwen3.6-35B-A3B-NVFP4-vLLM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Tested MiaAI-based DeepSeek V4 Flash speed profile for two ASUS GX10s: pinned patch, settings, and benchmark helper.☆15Sep 5, 2026Updated last month
- Universal AI computer-control KVM (REST API + MCP) that drives any machine as plain USB hardware — nothing installed on the target. Built…☆20Oct 6, 2026Updated 2 weeks ago
- Qwen3.6-27B (NVFP4) DFlash for DGX Spark☆22Jul 31, 2026Updated 2 months ago
- Production-ready vLLM deployment wrapper for Qwen3.6-27B (NVFP4) — self-hosted OpenAI-compatible inference☆60Jul 30, 2026Updated 2 months ago
- An environment where open models work as agents: a first-level harness with routing, skills, memory and sandboxed tools, on an engine tha…☆54Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Deploy DeepSeek V4 Flash (MoE reasoning model) on dual DGX Spark nodes with 1M token context, InfiniBand, and FP8 KV-cache☆106Aug 20, 2026Updated 2 months ago
- MiniMax-H3 33B audio+video DiT accelerated 1.54x on a single NVIDIA DGX Spark (GB10, sm_121): NVIDIA Sol-Engine FirstBlockCache + batched…☆35Aug 17, 2026Updated 2 months ago
- Verified Qwen3.8 Flash-Next GGUF recipe for one NVIDIA DGX Spark or ASUS Ascent GX10☆61Updated this week
- Serve Ornith-1.5-35B-A3B (NVFP4 + in-checkpoint MTP, 256k ctx) on one DGX Spark — vLLM b12x recipe plus CUDA-graph fixes.☆33Aug 19, 2026Updated 2 months ago
- vLLM 0.25.1 serving stack for poolside/Laguna-S-2.1-NVFP4 with DFlash speculative decoding — DGX Spark & RTX 6000 PRO☆81Jul 22, 2026Updated 3 months ago
- llama-server start/stop scripts for Qwen3.6-35B-A3B UD-Q8_K_XL GGUF on DGX Spark☆26Jul 6, 2026Updated 3 months ago
- Comparison of self-hostable memory providers for the Hermes agent on the MemConflict benchmark☆33Aug 10, 2026Updated 2 months ago
- vLLM deployment for Unsloth Qwen3.6-35B-A3B-NVFP4-Fast on NVIDIA DGX Spark☆70Jul 29, 2026Updated 2 months ago
- Local diagnostic CLI for NVIDIA DGX Spark (GB10). Detects power caps, UMA pressure, thermal risk, CUDA 13/SM_121 wheel mismatches, Docker…☆164Updated this week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- DGX Spark (GB10/sm_121) port: DeepSeek-V4-Flash 159B on one Spark, GLM-5.2 753B across two. Prepacked 2-bit planes + unified-memory fixes…☆19Jul 20, 2026Updated 3 months ago
- Herdr 软件全面调研、使用价值分析与上手教程 | An independent practical guide to Herdr☆26Aug 10, 2026Updated 2 months ago
- Spec-first rails for agent-assisted repository workflows.☆23Updated this week
- Streamline your plugin/theme workflows for the community directory.☆17Oct 14, 2026Updated last week
- qwen38-flash-next recipe for solo GB10☆157Updated this week
- CUDA Blackwell performance fork of antirez/ds4 (DeepSeek-V4-Flash): ~4x prefill, ~1.5x decode, continuous batching, weight server, DSpark☆77Sep 4, 2026Updated last month
- Open-source macOS AI computer use and native GUI automation on Apple silicon. Jev + OmniParser CoreML + Apple Vision OCR. Bring your own …☆24Sep 18, 2026Updated last month
- Custom inference recipes for NVIDIA DGX Spark — Qwen 122B DFlash hybrid☆89Updated this week
- Headless / multi-user serving-mode for the DGX Spark: free unified memory for vLLM by paring back the desktop. Companion to qwen3.5-122B-…☆19Jun 29, 2026Updated 3 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆22Sep 4, 2026Updated last month
- Setup wizard for Hermes Gateway Desktop☆32Jul 2, 2026Updated 3 months ago
- Free, keyless web_search and web_fetch for the DeepSeek Harness (dsh) — DuckDuckGo-backed, no signup. Unofficial community project.☆17Sep 28, 2026Updated 3 weeks ago
- GLM-5.3-Flash (NVFP4) at TP=4 across 4x ASUS GX10 / GB10 - vLLM + mentat instead of Ray, 524k context, DFlash2. Minimal working recipe.☆90Updated this week
- Serve Qwen3.8-Flash-Next (turboderp ExLlamaV3 pack) on one NVIDIA DGX Spark with exllamav3☆61Oct 14, 2026Updated last week
- Standalone Codex skill for Vox-inspired editorial collage knowledge videos with deterministic Remotion assembly and optional generated mo…☆25Jul 22, 2026Updated 3 months ago
- Portable personal advisor OS built from Agent Skills☆12Aug 12, 2026Updated 2 months ago
- Hermes Agent benchmark v0.1 — evaluate local models on the actual tool-calling patterns Hermes users hit. Reproducible, trace-capturing, …☆16Jun 24, 2026Updated 3 months ago
- Qwen3.8-Flash-Next on ONE DGX Spark (TP=1)☆614Oct 4, 2026Updated 2 weeks ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- DeepSeek V4 Flash specific inference engine. SSD MoE expert paging (slot-bank) + disk KV cache for long agent sessions. Metal-first, narr…☆33Sep 6, 2026Updated last month
- Profile repo — categorized index of NVFP4 model releases, DGX Spark inference stacks, Apple Silicon MLX builds, the voice-AI stack, and t…☆41Oct 6, 2026Updated 2 weeks ago
- Image and Mask Composition node bundle for InvokeAI☆13May 25, 2025Updated last year
- Rebuild a site's internal link map in seconds with Jev, race Claude Opus 5 on the same queue, and let a deep model rewrite the rubric fro…☆22Updated this week
- Local image generation and editing for NVIDIA DGX Spark, powered by Qwen-Image-2.1 and Gradio.☆31Sep 21, 2026Updated last month
- Cognitive memory for LLM agents — local-first, and shareable across a team through the cloud.☆40Updated this week
- KiChad — a Codex-integrated downstream of KiCad☆22Jul 24, 2026Updated 2 months ago