Serving DeepSeek-V4-Flash-0731-NVFP4 on 2x RTX PRO 6000 Blackwell (sm_120): vLLM patches, tuned configs, serve scripts, benchmarks
☆15Aug 25, 2026Updated 2 months ago
Alternatives and similar repositories for dsv4-flash-2x-rtxpro6000s
Users that are interested in dsv4-flash-2x-rtxpro6000s are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- GLM 5.3 Flash for 2x RTX 6000, Full Mixed EXL3 Support, Code C1 >220tps☆22Oct 25, 2026Updated last week
- A desktop app that connects Zotero, Obsidian, and AI into a single academic workflow. Automatically fetches journal articles, extracts fu…☆16Sep 23, 2026Updated last month
- ☆30Jul 30, 2026Updated 3 months ago
- A Python tool to measure the energy consumption of software☆16Feb 5, 2026Updated 8 months ago
- A Swift package that acts as a dynamic bridge between Apple's FoundationModels framework and any server implementing the Model Context Pr…☆14Nov 28, 2025Updated 11 months ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Navigate between Mardown headings with ease from within Neovim.☆12Jul 11, 2026Updated 3 months ago
- Flash-Flash KDA: H100-optimized Flash Kimi Delta Attention kernels☆24Jul 24, 2026Updated 3 months ago
- Fused MoE kernel☆24Updated this week
- Exact SGLang runtime for GLM-5.3-Flash-NVFP4 on 4x RTX PRO 6000 Blackwell (SM120): flashinfer_cutlass MoE, DSA+KDA attention, NEXTN MTP5,…☆17Aug 27, 2026Updated 2 months ago
- SGLang 0.5.21 for Qwen3.8-Flash-Next on one RTX PRO 6000: 264.5 tok/s decode, W4A16 routed experts (KLD 0.0111 vs BF16), 262K context, ex…☆17Oct 26, 2026Updated last week
- AQUATOPE: QoS-and-Uncertainty-Aware Resource Management for Multi-Stage Serverless Workflows (ASPLOS'23)☆25Mar 13, 2024Updated 2 years ago
- Self-hosted game stream host for Moonlight.☆20Aug 15, 2026Updated 2 months ago
- Run GPT-OSS-120B on a 16 GB Mac. Streams mixture-of-experts weights from SSD so only the 2 GiB trunk stays resident. Swift + Metal, no de…☆25Aug 7, 2026Updated 2 months ago
- A GPT-2 inference engine written from scratch in CUDA and C++. Implements custom CUDA kernels for tiled matrix multiplication, LayerNorm,…☆44May 17, 2026Updated 5 months ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Fully local: chat, a coding agent, and a design studio in one private desktop app.☆33Updated this week
- ANE (Apple Neural Engine) CostModel profiler for CoreML models☆36Apr 9, 2026Updated 6 months ago
- ☆10Oct 11, 2022Updated 4 years ago
- Artifacts of EuroSys'24 paper "Exploring Performance and Cost Optimization with ASIC-Based CXL Memory"☆31Feb 21, 2024Updated 2 years ago
- Generate SRT subtitle files from video using the Gladia speech-to-text API☆27Oct 3, 2026Updated last month
- Actual VM implementation of Another World game, with intro☆35Sep 28, 2026Updated last month
- Generate audio noise WAV files☆21May 31, 2026Updated 5 months ago
- ☆27Nov 29, 2024Updated last year
- Tools for visualizing neural nets☆25Jul 29, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A local-first cognitive architecture for building a persistent digital companion with memory, reasoning, personality, and long-term learn…☆29Sep 18, 2026Updated last month
- Mainline Linux / postmarketOS on the Galaxy Tab S8+ (SM-X800, SM8450): native display, Adreno GPU, KDE Plasma 6. First known Tab S8 mainl…☆28Sep 24, 2026Updated last month
- Optimizing diffusion for production-ready speeds☆41Jan 10, 2026Updated 9 months ago
- ML framework with tensors, autograd, NN modules, optimizers, transformers.☆21Sep 17, 2026Updated last month
- When an agent needs you, answer from your phone — self-hosted, end-to-end encrypted control of your coding agents.☆35Updated this week
- Allow an AI agent to control an iPad through a USB input tool, native screen sharing, and a control server.☆81Oct 13, 2026Updated 3 weeks ago
- Windows code for communicating with a VC707 evaluation board running a MIAOW compute unit.☆11Oct 20, 2015Updated 11 years ago
- Code for Fast Ternary Large Language Model Inference with Addition-Based Sparse GEMM on Edge Devices☆25Apr 17, 2026Updated 6 months ago
- tinygrad port of U^2 Net model☆13Oct 21, 2025Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Gemma 4 on iPhone as a Swift package: one dependency line, five lines of code, ~50 tok/s on iPhone 17 Pro. Metal GPU, text + image + audi…☆31Oct 5, 2026Updated 3 weeks ago
- ☆22Jul 15, 2024Updated 2 years ago
- LLM training parallelisms (DP, FSDP, TP, PP) in pure C☆29Jan 27, 2026Updated 9 months ago
- Reverse engineered Twitter's API☆12Nov 28, 2023Updated 2 years ago
- ☆38Jul 17, 2026Updated 3 months ago
- Sample code from the book "Professional CUDA C Programming"☆42May 23, 2023Updated 3 years ago
- MiMo-V2.5 NVFP4 4-bit weights + NVFP4 4-bit KV cache + DFlash speculative decoding on 2× NVIDIA DGX Spark — 1M context, 3.4M-token KV poo…☆18Jul 13, 2026Updated 3 months ago