A fork of jasl/vllm (codex/ds4-sm120-min-enable) with CPU-GPU hybrid inference support for DeepSeek-V4 on SM120+.
☆31Sep 10, 2026Updated last month
Alternatives and similar repositories for Lvllmds4
Users that are interested in Lvllmds4 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- CPU-GPU hybrid inference for DeepSeek-V4 on NVIDIA SM80+ (A100/RTX 4090 etc.), forked from yhfgyyf/vllm-deepseek-v4-sm89.☆60Sep 16, 2026Updated last month
- CAD files for DDR5 RDIMM cooling☆16Jun 12, 2025Updated last year
- Kali nethunter pro for OnePlus 6/6T☆17May 28, 2025Updated last year
- A cmpunlocker fork with working p2p on SYS-4028GR-TRT2☆26Aug 8, 2026Updated 2 months ago
- LvLLM is a special NUMA extension of vllm that makes full use of CPU and memory resources, reduces GPU memory requirements, and features …☆471Sep 22, 2026Updated last month
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- glm-5.2 on too many 64 / 80 GB A100's☆22Sep 9, 2026Updated last month
- Local LLM proxy, DevOps friendly☆14Oct 11, 2026Updated last week
- Production-ready Open WebUI extensions, including Tools, Filters, Pipes, Actions, and Events for agent workflows, RAG, learning, automati…☆35Sep 25, 2026Updated 3 weeks ago
- SGLang for GLM-5.3-Flash on two or four RTX PRO 6000 Blackwell GPUs (SM120), with TP2 W4A16 and TP4 NVIDIA NVFP4 profiles.☆46Oct 11, 2026Updated last week
- SonicScribe 是一个基于 GLM-ASR-Nano-2512 模型的 Web 原生实时语音转文字系统，采用前后端分离架构，支持低延迟、高准确率的语音识别服务。适用于会议记录、讲座整理、访谈笔记、日常对话等多种场景。☆25Jan 12, 2026Updated 9 months ago
- Unlock the Structure of Your Knowledge.A system to visualize knowledge points as a Directed Acyclic Graph (DAG) by analyzing markdown not…☆13Oct 5, 2026Updated 2 weeks ago
- Reproducible SGLang image for DeepSeek-V4-Flash-0731 on SM120☆37Aug 25, 2026Updated last month
- Aurelia custom element that takes (server- or client side) generated html and compiles it into a fully functional Aurelia View☆12Nov 12, 2018Updated 7 years ago
- DOS\Watcom C\C++ stuff (demos\utils\etc)☆11Jan 25, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Lsglang is a special extension of sglang that fully utilizes CPU and GPU computing resources with an efficient GPU parallel + NUMA parall…☆155Updated this week
- Describes how to setup Proxmox VE 6.2 with ZFS and device passthrough☆10Apr 14, 2021Updated 5 years ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆42Updated this week
- Minimalistic syslog for Docker containers☆10Sep 23, 2020Updated 6 years ago
- Winamp plugin to play SID files, based on libsidplayfp library.☆11Dec 13, 2025Updated 10 months ago
- C# library for 2D/3D geometric computation, mesh algorithms, and so on. Boost license.☆13Aug 25, 2023Updated 3 years ago
- Wrapper for "docker run" to handle systemd quirks☆13Oct 9, 2018Updated 8 years ago
- FuriatuneGUI is a graphical user interface for the furiatune to run on Amiga 600 with Furia Expansion Board only. The interface is very s…☆10Sep 19, 2017Updated 9 years ago
- Python/Twisted client for the Slack Real-Time Messaging API (RTM)☆11Sep 19, 2020Updated 6 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Aurelia async bindingbehavior to consume Observables and Promises☆17Jan 9, 2023Updated 3 years ago
- ☆16Oct 13, 2025Updated last year
- An enhanced implementation for observable and bindable decorator of Aurelia☆16May 4, 2022Updated 4 years ago
- 多引擎（FunASR / Qwen3）语音转录 + 说话人识别服务，WebSocket API，macOS / CUDA，支持音视频转写，分角色，自动合并相同人物的话。☆15Oct 1, 2026Updated 3 weeks ago
- A plugin for declaring deep/shallow computed observation☆15Jan 7, 2023Updated 3 years ago
- Use OpenCode in WeChat☆23Mar 22, 2026Updated 7 months ago
- A C# wrapper for CGAL☆15Jun 12, 2018Updated 8 years ago
- Enables possibility to build Win32-targeted applications with Bazel (`x86_32_windows` cpu)☆10Feb 14, 2019Updated 7 years ago
- Tuning and qualification harness for the NVIDIA CMP 170HX (GA100). Measures, gates and recovers clock/voltage settings, and treats a comp…☆90Sep 28, 2026Updated 3 weeks ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Built on the robust XTuner backend framework, XTuner Chat GUI offers a user-friendly platform for quick and efficient local model inferen…☆13Feb 5, 2024Updated 2 years ago
- A plugin skeleton for creating Aurelia plugins.☆18Dec 3, 2018Updated 7 years ago
- ☆23Dec 15, 2016Updated 9 years ago
- Mixed-precision acceleration patch for MiniMax H3 inference on NVIDIA V100☆39Sep 6, 2026Updated last month
- PIV模块☆16Jun 20, 2025Updated last year
- Distribute and run LLMs with a single file.☆25May 13, 2025Updated last year
- Interactive patcher for the Claude Code native binary. Live inline thinking, detailed tool calls, subagent model overrides, custom brandi…☆21Oct 15, 2026Updated last week