CPU-GPU hybrid inference for DeepSeek-V4 on NVIDIA SM80+ (A100/RTX 4090 etc.), forked from yhfgyyf/vllm-deepseek-v4-sm89.
☆60Sep 16, 2026Updated last month
Alternatives and similar repositories for Lvllmds4-x
Users that are interested in Lvllmds4-x are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- DeepSeek-V4-Flash-0731 on 4x CMP 170HX (sm_80): 98 tok/s decode, ~5300 tok/s prefill. DSpark speculative decoding under pipeline parallel…☆118Aug 13, 2026Updated 2 months ago
- Run DeepSeek-V4.1-Flash / DeepSeek-V4-Flash and GLM-5.3-Flash on SM89 (Ada / RTX 4090) and SM120 (RTX PRO 6000) with vLLM☆190Updated this week
- Dogfooding vLLM backport for older GPUs.☆315Updated this week
- Moderne Reverse Engineering IDE for AI Agents☆63Updated this week
- GLM-5.3-Flash on 4× NVIDIA CMP 170HX with vLLM: up to 482.6 tok/s single-user, up to 943.7 tok/s at 8 users, 262K context, TP4 or PP4, on…☆77Updated this week
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- vllm混合推理扩展插件，支持多NUMA混合推理，单卡推理Qwen3-Next模型可达1000+ prefill☆34Nov 7, 2025Updated 11 months ago
- Tuning and qualification harness for the NVIDIA CMP 170HX (GA100). Measures, gates and recovers clock/voltage settings, and treats a comp…☆89Sep 28, 2026Updated 2 weeks ago
- AGX Dynamics for Unreal plugin.☆13Updated this week
- A quiet desktop workspace for notes, tasks, projects, and a calendar. Free, open source, built with Flutter.☆32Aug 12, 2026Updated 2 months ago
- Spare: an honest Mac cleaner. Open source, MIT.☆34Updated this week
- C++/CUDA single-GPU inference engine for Qwen3.8 (incl. Qwen3.8-Flash-Next with offloaded experts) on the RTX 5090; grew from NInfer☆122Oct 12, 2026Updated last week
- Python-like syntax, compiled static language, zero memory overhead, direct C ecosystem access Simple, Fast, Safe, Cross-platform☆27Aug 6, 2026Updated 2 months ago
- Local-first BitTorrent TUI with a VPN kill-switch and in-app streaming.☆30Sep 24, 2026Updated 3 weeks ago
- AI agent with CLI, API and all prompts editable.☆15Updated this week
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Desktop IDE for working with multiple AI coding agents. Supports Claude, Codex, OpenCode, Cursor and Grok.☆45Updated this week
- Control coding agents from your phone — open-source, encrypted, and self-hosted.☆35Updated this week
- Use OpenCode in WeChat☆23Mar 22, 2026Updated 6 months ago
- Pixal3D ComfyUI integration for Windows (RTX 30/40/50) — single image to textured PBR mesh in 3-5 min☆28May 14, 2026Updated 5 months ago
- Lsglang is a special extension of sglang that fully utilizes CPU and GPU computing resources with an efficient GPU parallel + NUMA parall…☆149Updated this week
- SGLang for cool dudes using V100☆79Oct 5, 2026Updated last week
- A fully transparent in-editor agentic harness for large language models inside Godot Engine. Connect to any LLM provider via API (or use …☆38Updated this week
- GLM-5.3-Flash NVFP4 on 4x NVIDIA DGX Spark: vLLM TP4, DFlash2 adaptive draft, measured FP8 vs NVFP4 vs EXL3 vs SGLang☆37Sep 29, 2026Updated 2 weeks ago
- Bookmark OS: Your bookmarks as a desktop. Available on Chrome Web Store, Firefox Add-ons, and Edge Add-ons.☆41Oct 8, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆23Dec 15, 2016Updated 9 years ago
- Pi extension that adds CodeGraph-powered code intelligence tools to Pi Agent☆28Updated this week
- Free AI code reviews on every pull request. Bring your own key (OpenRouter free tier works), runs in your repo as a GitHub Action - no qu…☆42Updated this week
- SoloMapling v83 - Fully Simulated Artificial Players in an Old School MapleStory server. Based on Cosmic v83.☆203Jul 8, 2026Updated 3 months ago
- Metal acceleration project for the ASRock BC-250 on macOS. Based on ChefKiss' NootedRed project. LLMs are used in this project for debugg…☆38Oct 1, 2026Updated 2 weeks ago
- 🔥Next.js & WooCommerce integration with Apollo Client & WP-GraphQL for efficient ecommerce functionalities in WordPress.☆10Updated this week
- 公号三刀 · 公众号文章抓取下载导出工具☆154Updated this week
- Toolchain for Neversoft QScript☆13Aug 28, 2024Updated 2 years ago
- The complete NUMA-optimized branch of the ktransformers project☆26Nov 3, 2025Updated 11 months ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- A tool to unlobotomize your NVIDIA card!☆773Oct 8, 2026Updated last week
- ☆65Aug 6, 2026Updated 2 months ago
- Run MoE models beyond VRAM on AMD, NVIDIA & Intel GPUs. Vulkan-powered, portable Windows app with automatic setup. | 让游戏显卡跑起超显存大模型，支持 AMD…☆309Updated this week
- Every live OMP session. One private page, in any modern browser.☆43Updated this week
- Remove BlackCipher/BlackCall from your client☆10Sep 22, 2023Updated 3 years ago
- Automation Assistant for UI Task Execution.☆12Jan 3, 2025Updated last year
- llama.cpp modified to work with Strix Halo + dGPU as an accelerator, Dual Strix Halo Machines, or both☆51Updated this week