SGLang for cool dudes using V100
☆84Nov 6, 2026Updated this week
Alternatives and similar repositories for sglang-V100
Users that are interested in sglang-V100 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- vLLM fork for Tesla V100☆15May 31, 2026Updated 5 months ago
- Agentic-coding oriented inference engine for N x V100-SXM2, based on SGLang: GLM-5.3-Flash, Qwen3.8-Flash-Next, DeepSeek-V4.1-Flash, Mini…☆35Oct 7, 2026Updated last month
- Stable, high-throughput inference server for multi-GPU NVIDIA V100 (SM70): Qwen3.8 Flash-Next with AWQ / NVFP4, multimodal input, CPU/dis…☆48Updated this week
- 1Cat Studio: unified vLLM workbench, Codex Agent and creative canvas☆15Updated this week
- Hand-written NVFP4 W4A16 CUDA kernels for Volta☆181Aug 19, 2026Updated 2 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- marlin_v100 是一个从 vLLM 主树中提取出来的最小 Marlin 独立开发工作区，聚焦于 Marlin dense 与 Marlin MoE 的源码 开发、最小构建和轻量验证。它保留了核心 CUDA/C++ 实现、最小 Python 薄封装、生成器测试与主树回写…☆26Jul 2, 2026Updated 4 months ago
- Auto-built Docker image of 1Cat-vLLM for NVIDIA Tesla V100 (sm_70/Volta) with CUDA 12.8 — rebuilt daily when upstream releases☆12Jul 22, 2026Updated 3 months ago
- LLM inference in C/C++☆22Oct 25, 2026Updated last week
- Implementation of FlashAttention-2 for Nvidia Tesla V100 / Titan V☆217Updated this week
- NInfer on Tesla V100 (sm_70): Qwen3.8-27B deployment, build/convert scripts, systemd service, and cross-engine benchmark (vs llama.cpp). …☆53Sep 15, 2026Updated last month
- 1Cat-vLLM on Intel Gaudi☆47Oct 12, 2026Updated 3 weeks ago
- Block-FP8 (W8A16) on NVIDIA V100 / Volta (sm_70) for vLLM — the FP8 path upstream drops on Volta, tuned for sparse MoE.☆15Jul 10, 2026Updated 3 months ago
- 这是一套 MiniMax H3 本地部署与性能优化整理：在 4 张 22 GB RTX 2080 Ti 上，通过 Raylight FSDP/USP、双组NVLink、多卡 Qwen 文本编码节点、SM75 SageAttention 和通信流水，让MiniMax H3 的…☆25Aug 12, 2026Updated 2 months ago
- forked from vllm-project/flash-attention☆74May 9, 2026Updated 5 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- This project is specifically developed for V100, based on lmdeploy 0.12.1, and supports mainstream open-source models from Q4 2025 to Q1 …☆22Mar 18, 2026Updated 7 months ago
- ComfyUI custom node: run MiniMax H3 at near-fp16 speed with near-fp32 numerical stability on GPUs without bf16/fp8 hardware (V100 sm_70)☆19Aug 22, 2026Updated 2 months ago
- Flash Attention v2 for Pascal (P100, GTX 1080) and Volta (V100) GPUs — bringing O(N) memory attention to hardware the official flash-attn…☆30Updated this week
- llama.cpp optimized for NVIDIA Tesla V100 (SM70). Qwen3.8-Flash-Next (MoE) with MTP on 1/2/3/6x V100-16GB at 262K context (6 GPUs: prefil…☆71Updated this week
- The set-and-forget LLM engine for Pascal and Volta: PXQ codec + kernels, auto-tuned per card. Ready-to-run PXQ models in MODELS.md; bench…☆114Updated this week
- Configurations and scripts for working with the Tesla V100 32Gb.☆17Sep 8, 2026Updated last month
- ComfyUI MiniMax H3 inference optimizations for NVIDIA Tesla V100 (SM70)☆31Sep 29, 2026Updated last month
- Curated V100 SXM2 pin maps, two- and four-GPU NVLink connection plans, and connector-only KiCad resources toward an open-source carrier b…☆51Updated this week
- Claude control for KiisuV4b☆13Aug 5, 2026Updated 3 months ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Fast & lightweight interface for running Nano Banana LLM and compact local models on your PC. Optimized for high-speed AI interactions.☆44Mar 17, 2026Updated 7 months ago
- DeepSeek-V4-Flash-0731 on 4x CMP 170HX (sm_80): 98 tok/s decode, ~5300 tok/s prefill. DSpark speculative decoding under pipeline parallel…☆118Aug 13, 2026Updated 2 months ago
- Run Qwen3.8-Flash-Next on one AMD Strix Halo (Ryzen AI Max+ 395, gfx1151). EXL3 4.05 and 3.05 bpw packs, own ROCm/HIP kernels, OpenAI-com…☆19Updated this week
- Dogfooding vLLM backport for older GPUs.☆359Updated this week
- Covert Coder — a local-first sovereign AI development environment for governed models, workflows, execution, evidence, and verification.☆53Oct 26, 2026Updated last week
- Easy install Autodesk products on Fedora☆12Aug 18, 2020Updated 6 years ago
- Local Codex-style desktop GUI for the Pi coding agent☆34Jun 29, 2026Updated 4 months ago
- Third party commentaries for UniqueBible☆13Apr 8, 2021Updated 5 years ago
- ☆10Sep 16, 2026Updated last month
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Qwen3.8 Local Coding on a 16GB GPU☆27Sep 18, 2026Updated last month
- An open benchmark arena for coding agent harnesses, built for the Pi community☆12Oct 21, 2026Updated 2 weeks ago
- Low-cost (approx. 1000R) biaxial equatorial mount using dual S14-100/S17-100 harmonic reducers, 1:5.18 planetary reducers, 42H48 stepper …☆15Aug 26, 2024Updated 2 years ago
- Feature complete implementation of IEC870-5-103 protocol☆18Dec 12, 2022Updated 3 years ago
- ☆11Feb 11, 2015Updated 11 years ago
- A LD_PRELOAD library to share CUDA VRAM weights across multiple processes using IPC.☆12Jun 30, 2026Updated 4 months ago
- Kotai is a fully local, zero-cost voice assistant that combines the power of Kyutai TTS/STT, LiveKit, and local LLMs to create natural co…☆10Jul 14, 2025Updated last year