☆21Apr 7, 2026Updated 7 months ago
Alternatives and similar repositories for vllm-custom
Users that are interested in vllm-custom are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆76Feb 27, 2026Updated 8 months ago
- Linux hwmon driver for the NVIDIA DGX Spark (GB10 SoC) that exposes full system power telemetry via standard sensors / sysfs interfaces.☆40Mar 2, 2026Updated 8 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆13Apr 14, 2026Updated 7 months ago
- ☆16Jun 27, 2026Updated 4 months ago
- vLLM fork with Marlin W4A8 SM121 patches + TMA module☆15Mar 23, 2026Updated 7 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- FlashQLA TileLang GDN kernels ported to NVIDIA Blackwell consumer (GB10 / DGX Spark)☆18Jun 5, 2026Updated 5 months ago
- A dedicated effort to make an optimized, bleeding edge vLLM image using Docker to support DGX comprehensively☆128Feb 22, 2026Updated 8 months ago
- DGX Spark EC fan speed override / rollback tool☆25Aug 23, 2026Updated 2 months ago
- ☆23Dec 12, 2025Updated 11 months ago
- A LD_PRELOAD library to share CUDA VRAM weights across multiple processes using IPC.☆12Jun 30, 2026Updated 4 months ago
- Archived fork of antirez/ds4 for GB10 DSpark — continues as Athena: github.com/xangel82/Athena-Engine☆28Oct 30, 2026Updated 2 weeks ago
- A model loader that uses fastsafetensors library to perform a fast, zero-copy load from storage to VRAM.☆23Jan 21, 2026Updated 9 months ago
- Simple OpenCL offline compiler☆13Jan 13, 2025Updated last year
- My Repo for AI stuff☆13Nov 3, 2026Updated last week
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Run sensitive operations without leaving secrets around.☆19Oct 8, 2026Updated last month
- ☆12Aug 31, 2026Updated 2 months ago
- Qwen 3.8 Flash NVFP4 with PLE NVFP4 quantized to run on a single DGX Spark☆15Aug 28, 2026Updated 2 months ago
- 4-5x faster Qwen3.5 on ASUS GX10 / DGX Spark — Hybrid INT4+FP8 + MTP via one shell script☆32Apr 16, 2026Updated 6 months ago
- MCP server that delegates Claude Code agent work to local models (llama.cpp / vLLM) on your own hardware☆19Nov 2, 2026Updated 2 weeks ago
- Fast, capable GLM-5.3-Flash FP4-Local on two DGX Sparks: opinionated Atlas serving and reproducible inference research.☆73Updated this week
- Qwen-Image 2.1 on TensorFold's NVFP4 kernels: a drop-in ComfyUI loader, 4x faster than the GGUF path on one RTX 5070 Ti (native Windows).…☆11Oct 3, 2026Updated last month
- A compiler-driven simulator for M5Stack StopWatch (C152) firmware: the production C++ runs on your Mac with the device's own font metrics…☆33Aug 20, 2026Updated 2 months ago
- A fork which adds a UI to the original deep-research tool☆11Feb 8, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆12Nov 22, 2025Updated 11 months ago
- Local voice assistant using Gemma4☆19Jun 9, 2026Updated 5 months ago
- ☆23Aug 10, 2026Updated 3 months ago
- ☆13Apr 28, 2026Updated 6 months ago
- Writing An Interpreter In Rust (Writing An Interpreter In Go in Rust)☆13Sep 6, 2019Updated 7 years ago
- A backend server for running Video Gen AI models like LTX in low-VRAM (16GB) environments. Includes a simple Gradio UI.☆13Updated this week
- Small experimental Unity project: DXR + Spline☆14Sep 13, 2023Updated 3 years ago
- An Enhanced TOP program to monitor your Nvidia DGX SPARK's Hardware☆38Jan 6, 2026Updated 10 months ago
- Browser-based model and inference management for NVIDIA DGX Spark - inventory local and Hugging Face models, manage Ollama and LiteLLM, g…☆57Oct 18, 2026Updated 3 weeks ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- vLLM 0.25.1 serving stack for poolside/Laguna-S-2.1-NVFP4 with DFlash speculative decoding — DGX Spark & RTX 6000 PRO☆81Jul 22, 2026Updated 3 months ago
- The category map for agent credential management. Products, integrations, recipes, patterns, threat models. Curated by Authsome.☆12Jun 2, 2026Updated 5 months ago
- A collection of USD tools that use a number of AI interfaces MCP and Agent2Agent.☆19Oct 6, 2025Updated last year
- Pixel-perfect editing for Qwen-Image-Edit-2511 in ComfyUI☆19Jul 9, 2026Updated 4 months ago
- Pinned one-DGX-Spark Docker recipe for DeepSeek V4 Flash with EXL3, SparkInfer, and 262K NVFP4 MLA KV cache☆31Sep 6, 2026Updated 2 months ago
- ☆23Sep 8, 2026Updated 2 months ago
- Scitrera builds of various CUDA containers for version consistency, starting primarily with NVIDIA DGX Spark Containers☆42Aug 21, 2026Updated 2 months ago
Are these results useful?