Hand-written NVFP4 W4A16 CUDA kernels for Volta
☆181Aug 19, 2026Updated 2 months ago
Alternatives and similar repositories for v100-skinny
Users that are interested in v100-skinny are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- SGLang for cool dudes using V100☆84Updated this week
- High-performance single-GPU inference for selected model checkpoints and GPUs.☆260Sep 14, 2026Updated last month
- Stable, high-throughput inference server for multi-GPU NVIDIA V100 (SM70): Qwen3.8 Flash-Next with AWQ / NVFP4, multimodal input, CPU/dis…☆45Updated this week
- vLLM fork for Tesla V100☆15May 31, 2026Updated 5 months ago
- V100 / SM70-focused vLLM engineering fork for modern LLM inference.☆1,472Updated this week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Qwen3.8-27B in native NVFP4/FP8 on 2x PCIe Tesla V100-32GB (SM70): the PCIe runbook for v100-skinny + 1Cat-vLLM, with the 3 fixes that ma…☆16Sep 13, 2026Updated last month
- Fork of llama.cpp Nvida Volta V100 (tensor parallelism 4 x v100 GPU)☆12Updated this week
- Block-FP8 (W8A16) on NVIDIA V100 / Volta (sm_70) for vLLM — the FP8 path upstream drops on Volta, tuned for sparse MoE.☆15Jul 10, 2026Updated 3 months ago
- Auto-built Docker image of 1Cat-vLLM for NVIDIA Tesla V100 (sm_70/Volta) with CUDA 12.8 — rebuilt daily when upstream releases☆12Jul 22, 2026Updated 3 months ago
- Implementation of FlashAttention-2 for Nvidia Tesla V100 / Titan V☆217Oct 14, 2026Updated 3 weeks ago
- llama.cpp optimized for NVIDIA Tesla V100 (SM70). Qwen3.8-Flash-Next (MoE) with MTP on 1/2/3/6x V100-16GB at 262K context (6 GPUs: prefil…☆71Updated this week
- forked from vllm-project/flash-attention☆74May 9, 2026Updated 5 months ago
- marlin_v100 是一个从 vLLM 主树中提取出来的最小 Marlin 独立开发工作区，聚焦于 Marlin dense 与 Marlin MoE 的源码开发、最小构建和轻量验证。它保留了核心 CUDA/C++ 实现、最小 Python 薄封装、生成器测试与主树回写…☆26Jul 2, 2026Updated 4 months ago
- Agentic-coding oriented inference engine for N x V100-SXM2, based on SGLang: GLM-5.3-Flash, Qwen3.8-Flash-Next, DeepSeek-V4.1-Flash, Mini…☆35Oct 7, 2026Updated 3 weeks ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A cmpunlocker fork with working p2p on SYS-4028GR-TRT2☆27Aug 8, 2026Updated 2 months ago
- vLLM fork for Tesla V100 (SM70) — extends 1CatAI's AWQ support and adds GGUF support☆26Jun 20, 2026Updated 4 months ago
- This project is specifically developed for V100, based on lmdeploy 0.12.1, and supports mainstream open-source models from Q4 2025 to Q1 …☆22Mar 18, 2026Updated 7 months ago
- ComfyUI MiniMax H3 inference optimizations for NVIDIA Tesla V100 (SM70)☆31Sep 29, 2026Updated last month
- The set-and-forget LLM engine for Pascal and Volta: PXQ codec + kernels, auto-tuned per card. Ready-to-run PXQ models in MODELS.md; bench…☆114Updated this week
- A tool to unlobotomize your NVIDIA card!☆834Oct 28, 2026Updated last week
- 1Cat Studio: unified vLLM workbench, Codex Agent and creative canvas☆15Updated this week
- Context management proxy for AI coding agents: verbatim archive, on-demand recall, and saved engine state on supported backends.☆50Updated this week
- A 198t/s and 353t/s qwen 3.8 27b inferencing engine for 2*v100 and 4*v100☆98Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- FlashAttention brought back to Tesla V100 — a deep llama.cpp fork: SM 7.0 D256 kernels, SplitKV3, q4_0 KV cache, DFlash2 speculative deco…☆19Updated this week
- Benchmarks and notes for running modern LLMs with vLLM on 8x Tesla V100-32GB in 2026.☆23Jul 10, 2026Updated 3 months ago
- Sol-Attn (arXiv 2607.24027) sparse acceleration for MiniMax H3 on V100 — single-node ComfyUI plugin (embedded FP16Safe + keep-or-drop ker…☆33Aug 29, 2026Updated 2 months ago
- Flash Attention v2 for Pascal (P100, GTX 1080) and Volta (V100) GPUs — bringing O(N) memory attention to hardware the official flash-attn…☆30Updated this week
- Run MiniMax H3 at native fp16 on pre-bf16 GPUs (V100/Volta) — exact-math fix for the black-frame overflows, ~11× faster than the fp32 fal…☆58Aug 8, 2026Updated 2 months ago
- A ComfyUI custom node enabling **Flash Attention 1** on legacy NVIDIA GPUs (Tesla V100, T4) that lack Compute Capability 8.0+ required by…☆33Feb 9, 2026Updated 8 months ago
- VENDORIZED in lucebox-hub. Fork of llama.cpp, ggml graph for lucebox inference engine☆29Jul 8, 2026Updated 3 months ago
- Proxima lets existing GPUs serve 4x more concurrent requests☆26Aug 19, 2026Updated 2 months ago
- Deterministic PyGhidra extraction, triage, and local LLM compiler-backend pipeline for C reimplementation.☆11Oct 18, 2026Updated 2 weeks ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- GPUDirect Storage (GDS) for the NVIDIA CMP 170HX on modern Linux kernels (6.18+). nvidia-fs NVMe registration hooks for the new blk_rq_dm…☆18Aug 19, 2026Updated 2 months ago
- Known-good vLLM recipe: Qwen3.8-27B-Int8 + MTP speculative decoding on NVIDIA CMP 170HX 64GB (Hynix) — 84 tok/s, 262k ctx☆13Oct 8, 2026Updated 3 weeks ago
- Unlocking NVIDIA CMP 90HX (GA102): kernel 6.12☆46Aug 22, 2026Updated 2 months ago
- Build and benchmark notes for houston, a local LLM inference server with four Tesla P100 16GB cards (64GB VRAM): hardware, BIOS fix, llam…☆23Oct 22, 2026Updated 2 weeks ago
- xllama.cpp — Optimized LLM Inference for NVidia Tesla V100-SXM2-32GB☆17Apr 29, 2026Updated 6 months ago
- NInfer SM80 port for NVIDIA CMP 170HX☆29Aug 22, 2026Updated 2 months ago
- Modified for AMD MI50 GPUs | A high-throughput and memory-efficient inference and serving engine for LLMs☆15Mar 2, 2026Updated 8 months ago