A fork of jasl/vllm (codex/ds4-sm120-min-enable) with CPU-GPU hybrid inference support for DeepSeek-V4 on SM120+.
☆32Sep 10, 2026Updated 2 months ago
Alternatives and similar repositories for Lvllmds4
Users that are interested in Lvllmds4 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- CPU-GPU hybrid inference for DeepSeek-V4 on NVIDIA SM80+ (A100/RTX 4090 etc.), forked from yhfgyyf/vllm-deepseek-v4-sm89.☆61Sep 16, 2026Updated last month
- LvLLM is a special NUMA extension of vllm that makes full use of CPU and memory resources, reduces GPU memory requirements, and features …☆474Nov 6, 2026Updated last week
- SGLang is a fast serving framework for large language models and vision language models.☆16Updated this week
- A cmpunlocker fork with working p2p on SYS-4028GR-TRT2☆27Aug 8, 2026Updated 3 months ago
- An Enhanced TOP program to monitor your Nvidia DGX SPARK's Hardware☆12Jan 10, 2026Updated 10 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Cross-tier CPU/GPU hybrid MoE inference for SGLang (plugin, tracks upstream main)☆72Updated this week
- dsv41-flash-pp5-170hx &pp6 Supports the original (full/unquantized) model. Prefill 7,000 t/s, decode 45-75-125 t/s. dspark. Requires 200 …☆13Updated this week
- Single-card Intel Gaudi2 vLLM source snapshot: FP8 Qwen, non-greedy DFlash2/MTP, GDN kernels and host-side optimizations.☆18Updated this week
- AMDGPU bindings for Flux☆10Apr 6, 2021Updated 5 years ago
- PCIe P2P on consumer RTX 5090 via one GSP firmware registry key — no driver patches.☆25Apr 17, 2026Updated 6 months ago
- DeepSeek-V4.1-Flash on 4× NVIDIA CMP 170HX with vLLM: up to 297 tok/s for one user, up to 868 tok/s at eight, 262K context, one-command c…☆28Nov 2, 2026Updated last week
- DeepSeek-V4-Flash W4A16-FP8 quantization on 8x H200 — patches, recipe, mission report☆13Sep 26, 2026Updated last month
- ☆28Oct 20, 2026Updated 3 weeks ago
- It's interpreters all the way down.☆13May 12, 2021Updated 5 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- DeepSeek-V4.1-Flash (764B) on 4×CMP 170HX: PP4 + shadow KV + EXL3 2bpw + DSpark + 512k ctx + native vision — patches, recipes, acceptance…☆15Sep 29, 2026Updated last month
- vLLM for NVIDIA CMP 170HX (Ampere sm_80): fast, repeatable model serving on one card or several☆28Nov 2, 2026Updated last week
- Three.js 3D skills - scenes, camera, lights, materials, geometries☆11Oct 3, 2026Updated last month
- Aurelia custom element that takes (server- or client side) generated html and compiles it into a fully functional Aurelia View☆12Nov 12, 2018Updated 8 years ago
- Code-regrouping to reduce latency in Julia code compilation☆16Jun 25, 2026Updated 4 months ago
- VENDORIZED in lucebox-hub. Fork of llama.cpp, ggml graph for lucebox inference engine☆29Jul 8, 2026Updated 4 months ago
- Julia interface to the HSA runtime, for supporting AMD GPUs☆15Aug 13, 2020Updated 6 years ago
- ULP testing for Floating Point special functions.☆15Apr 21, 2026Updated 6 months ago
- An enhanced implementation for observable and bindable decorator of Aurelia☆16May 4, 2022Updated 4 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A high-throughput and memory-efficient inference and serving engine for LLMs☆40Aug 13, 2026Updated 2 months ago
- GLM-5.2 (744B/40B MoE) on a 4× DGX Spark / GB10 (sm_121) cluster: portable Triton sparse-MLA kernels, a data-free expert prune, MTP draft…☆37Aug 20, 2026Updated 2 months ago
- Docker images for LLM inference (SGLang + vLLM) on NVIDIA Blackwell GPUs (SM120, CUDA 13.2)☆100Oct 20, 2026Updated 3 weeks ago
- Experimental compiler infrastructure for KernelAbstractions☆16Feb 24, 2026Updated 8 months ago
- Use OpenCode in WeChat☆23Mar 22, 2026Updated 7 months ago
- Live dashboard: fire N parallel streaming coding-agent runs at any OpenAI-compatible endpoint — per-run TTFT/tok-s/E2E, real kill switch,…☆26Jul 23, 2026Updated 3 months ago
- ☆17Aug 13, 2026Updated 2 months ago
- ☆23Dec 15, 2016Updated 9 years ago
- A pure-Julia, BLIS-style dgemm demo.☆16Sep 13, 2018Updated 8 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A tool to unlobotomize your NVIDIA card!☆841Oct 28, 2026Updated 2 weeks ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆38Nov 4, 2026Updated last week
- Hardware-adapted bridges that support devices using CAN protocol.☆21Jan 12, 2026Updated 10 months ago
- A plugin skeleton for creating Aurelia plugins.☆18Dec 3, 2018Updated 7 years ago
- HX 家族多功能工具箱：NVIDIA CMP 全系矿卡（30HX/40HX/50HX/70HX/90HX/170HX）工作台——固件解锁、型号伪装、双卡调度、动态省电、快照回滚。单文件免安装，前端与工具包全部内嵌。☆46Oct 25, 2026Updated 2 weeks ago
- 在 Android 上免 root 运行 Ubuntu 24.04，用来安装 CLI Agent☆18Nov 1, 2026Updated last week
- fastllm是后端无依赖的高性能大模型推理库，帮助您在大部分设备上高效推理大模型！☆5,130Updated this week
Are these results useful?