Agentic-coding oriented inference engine for N x V100-SXM2, based on SGLang: GLM-5.3-Flash, Qwen3.8-Flash-Next, DeepSeek-V4.1-Flash, MiniMax-H3.
☆35Oct 7, 2026Updated last month
Alternatives and similar repositories for sglang-sxm2
Users that are interested in sglang-sxm2 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- SGLang for cool dudes using V100☆83Updated this week
- NInfer on Tesla V100 (sm_70): Qwen3.8-27B deployment, build/convert scripts, systemd service, and cross-engine benchmark (vs llama.cpp). …☆53Sep 15, 2026Updated last month
- llama.cpp optimized for NVIDIA Tesla V100 (SM70). Qwen3.8-Flash-Next (MoE) with MTP on 1/2/3/6x V100-16GB at 262K context (6 GPUs: prefil…☆73Updated this week
- Stable, high-throughput inference server for multi-GPU NVIDIA V100 (SM70): Qwen3.8 Flash-Next with AWQ / NVFP4, multimodal input, CPU/dis…☆48Updated this week
- Auto-built Docker image of 1Cat-vLLM for NVIDIA Tesla V100 (sm_70/Volta) with CUDA 12.8 — rebuilt daily when upstream releases☆12Jul 22, 2026Updated 3 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 1Cat Studio: unified vLLM workbench, Codex Agent and creative canvas☆15Updated this week
- Qwen3.8-27B in native NVFP4/FP8 on 2x PCIe Tesla V100-32GB (SM70): the PCIe runbook for v100-skinny + 1Cat-vLLM, with the 3 fixes that ma…☆16Sep 13, 2026Updated last month
- Fork of llama.cpp Nvida Volta V100 (tensor parallelism 4 x v100 GPU)☆12Updated this week
- 1Cat-vLLM on Intel Gaudi☆47Oct 12, 2026Updated 3 weeks ago
- Third party commentaries for UniqueBible☆13Apr 8, 2021Updated 5 years ago
- Open source Python framework for AI agents. Unlike ReAct-based tools, intermediate data never passes through LLM context, so costs don't …☆13Jul 5, 2026Updated 4 months ago
- DeepSeek-V4.1-Flash inference on NVIDIA Ampere with vLLM, SM80 patches, reproducible throughput and coding-agent benchmarks. Tested on 8x…☆20Sep 15, 2026Updated last month
- V100 / SM70-focused vLLM engineering fork for modern LLM inference.☆1,480Updated this week
- Block-FP8 (W8A16) on NVIDIA V100 / Volta (sm_70) for vLLM — the FP8 path upstream drops on Volta, tuned for sparse MoE.☆15Jul 10, 2026Updated 3 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- FlashAttention brought back to Tesla V100 — a deep llama.cpp fork: SM 7.0 D256 kernels, SplitKV3, q4_0 KV cache, DFlash2 speculative deco…☆19Nov 1, 2026Updated last week
- Galahad by Corbenic☆53Updated this week
- Hand-written NVFP4 W4A16 CUDA kernels for Volta☆181Aug 19, 2026Updated 2 months ago
- Curated V100 SXM2 pin maps, two- and four-GPU NVLink connection plans, and connector-only KiCad resources toward an open-source carrier b…☆52Updated this week
- Fast & lightweight interface for running Nano Banana LLM and compact local models on your PC. Optimized for high-speed AI interactions.☆44Mar 17, 2026Updated 7 months ago
- A 198t/s and 353t/s qwen 3.8 27b inferencing engine for 2*v100 and 4*v100☆102Updated this week
- Strata port for Tesla V100 (sm_70): Qwen3.8-Flash-Next with 262K context and MTP☆131Updated this week
- DeepSeek V4 Flash 284B on AMD Strix Halo (gfx1151) — up to 32 tok/s decode & ~250 tok/s prefill via ROCmFPX, DSpark & ROCm 7.2☆20Aug 28, 2026Updated 2 months ago
- Run Qwen3.8-Flash-Next on one AMD Strix Halo (Ryzen AI Max+ 395, gfx1151). EXL3 4.05 and 3.05 bpw packs, own ROCm/HIP kernels, OpenAI-com…☆19Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Netflix and Crunchyroll on NordicTrack GlassOS consoles, no iFit subscription☆28Nov 1, 2026Updated last week
- An open benchmark arena for coding agent harnesses, built for the Pi community☆12Oct 21, 2026Updated 2 weeks ago
- ☆12Mar 16, 2026Updated 7 months ago
- Known-good vLLM recipe: Qwen3.8-27B-Int8 + MTP speculative decoding on NVIDIA CMP 170HX 64GB (Hynix) — 84 tok/s, 262k ctx☆13Oct 8, 2026Updated last month
- Chrome extension that displays your bookmarks on a new tab page☆14Aug 13, 2024Updated 2 years ago
- This project is specifically developed for V100, based on lmdeploy 0.12.1, and supports mainstream open-source models from Q4 2025 to Q1 …☆22Mar 18, 2026Updated 7 months ago
- High-performance single-GPU inference for selected model checkpoints and GPUs.☆261Sep 14, 2026Updated last month
- Deterministic PyGhidra extraction, triage, and local LLM compiler-backend pipeline for C reimplementation.☆11Oct 18, 2026Updated 3 weeks ago
- Firmware that drives the 2nd generation Afridev Sensor☆15May 7, 2021Updated 5 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Run Gemma 4 26B-A4B, fast.☆17Oct 26, 2026Updated last week
- The wireless split keyboard firmware using ZMK has been optimized for E-ink screens and the Cirque trackpad.☆19Sep 17, 2026Updated last month
- GPUDirect Storage (GDS) for the NVIDIA CMP 170HX on modern Linux kernels (6.18+). nvidia-fs NVMe registration hooks for the new blk_rq_dm…☆18Aug 19, 2026Updated 2 months ago
- A Chrome Extension to make a Google Calendar event from a selection of text.☆11Mar 13, 2018Updated 8 years ago
- Local Anthropic API proxy that routes through Claude Code CLI — use your subscription, no API keys needed☆15Apr 24, 2026Updated 6 months ago
- AI Optimized Markdown Kanban Board☆15Sep 9, 2026Updated 2 months ago
- 🟢 A modern desktop workspace for Claude Code. Open source.☆11Jul 31, 2026Updated 3 months ago