DeepSeek-V4-Flash-0731 on 4x CMP 170HX (sm_80): 98 tok/s decode, ~5300 tok/s prefill. DSpark speculative decoding under pipeline parallelism, which vLLM does not support upstream.
☆118Aug 13, 2026Updated 2 months ago
Alternatives and similar repositories for deepseek-v4-cmp170hx
Users that are interested in deepseek-v4-cmp170hx are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Tuning and qualification harness for the NVIDIA CMP 170HX (GA100). Measures, gates and recovers clock/voltage settings, and treats a comp…☆89Sep 28, 2026Updated 2 weeks ago
- CMP 170HX technical wiki: silicon, firmware, the community unlock, procedures and open problems. 55 pages.☆71Aug 22, 2026Updated last month
- Community-tested recipes, diagnostics, and benchmarks for CMP 170HX AI workloads☆83Oct 10, 2026Updated last week
- Fast & lightweight interface for running Nano Banana LLM and compact local models on your PC. Optimized for high-speed AI interactions.☆43Mar 17, 2026Updated 7 months ago
- The most comprehensive community resource for the NVIDIA CMP 170HX.☆125Jul 30, 2026Updated 2 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- 解锁自有 NVIDIA CMP 170HX / 90HX 的算力限制。Linux x86-64，需要 root。☆57Aug 6, 2026Updated 2 months ago
- Serve EXL3 (ExLlamaV3 trellis) quantized models on vLLM fork runtimes — any architecture, mixed per-layer bitrates, composable with sourc…☆26Updated this week
- A tool to unlobotomize your NVIDIA card!☆769Oct 8, 2026Updated last week
- AGX Dynamics for Unreal plugin.☆13Updated this week
- NVIDIA's official DLSS 3/4/4.5 on AMD RDNA3/4 GPUs on Windows and Linux.☆290Updated this week
- 🐼 Steer your LLMs and agents at the token level: A web tool for token visualization & control, model inspection, and LLM & agent traject…☆61Updated this week
- cpp write language detect model☆11Sep 22, 2021Updated 5 years ago
- Multi-agent fork of OpenAI Symphony — drives Codex, Claude Code, Gemini, and Pi CLIs from one orchestrator with a Jira-style CLI Kanban T…☆34Updated this week
- Lightweight Kanban board for Hermes Agent. SQLite-backed, dark/light themes, drag & drop, auto-detects agents from Hermes profiles.☆51Jun 21, 2026Updated 3 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- A Rust library for draping polygons over terrain with gfx☆11Mar 5, 2018Updated 8 years ago
- AI agent with CLI, API and all prompts editable.☆15Updated this week
- Moderne Reverse Engineering IDE for AI Agents☆63Updated this week
- Bash script presents crontab in human readable form.☆11Apr 21, 2018Updated 8 years ago
- ☆65Aug 6, 2026Updated 2 months ago
- An HTTP reverse proxy server for easy Couchdb proxy authentication☆28Mar 21, 2018Updated 8 years ago
- Open-source, local-first 3D parametric CAD that runs in the browser for people and permissioned typed agents, powered by OpenCascade WASM…☆514Aug 17, 2026Updated 2 months ago
- Proxy based on QUIC.☆11Updated this week
- Local Video RAG Engine. A FastAPI microservice for video understanding: Scene Detection + Whisper ASR + Qwen3-VL. Optimized for Apple Sil…☆39Dec 4, 2025Updated 10 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- 🔥Next.js & WooCommerce integration with Apollo Client & WP-GraphQL for efficient ecommerce functionalities in WordPress.☆10Updated this week
- Local text-to-speech: 28 voices, 10 languages, voice cloning, SDKs for Python, Swift, Go, Rust and TypeScript☆27Updated this week
- ComfyUI nodes for TencentARC Pixal3D image-to-3D generation☆31Jun 1, 2026Updated 4 months ago
- ☆125Aug 20, 2026Updated last month
- Symfony2 Docker environment☆14Aug 23, 2014Updated 12 years ago
- Toolchain for Neversoft QScript☆13Aug 28, 2024Updated 2 years ago
- Heterogeneous prefill/decode for DeepSeek-V4-Flash: CUDA prefill (DGX Spark, vLLM) -> Metal decode (Mac Studio, oMLX) over plain 10GbE☆151Updated this week
- Portable optimized ROCm and Qwen3.8-27B setup for AMD Strix Halo☆83Sep 16, 2026Updated last month
- An example implementatation of synchronized queue for inter-process communication in shared memory☆13Feb 17, 2017Updated 9 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Qwen 3.8 27B at 48-65 tok/s on a Mac Studio M4 Max — measured oMLX native-MTP recipe, same-day A/B vs mlx-vlm+MTP sidecar, raw benchmark …☆68Aug 21, 2026Updated last month
- PSSA: a non-transformer language model written from scratch in Rust. Recurrent state-space layer, episodic memory, self-modifying weights…☆116Updated this week
- ☆96Aug 10, 2026Updated 2 months ago
- Run CUDA-targeted Windows applications on AMD GPUs with ZLUDA + ROCm/HIP.☆321Updated this week
- Pure-Rust GGUF inference engine with quantized CPU, Metal & CUDA kernels, MoE support, OpenAI-compatible server. Benchmarked head-to-head…☆62Sep 23, 2026Updated 3 weeks ago
- Sushi engine runs very high quality quant model in Apple Silicon, using hybrid affine/exl3 with special expert tuning techniques.☆270Updated this week
- ☆38Mar 30, 2026Updated 6 months ago