Auto-built Docker image of 1Cat-vLLM for NVIDIA Tesla V100 (sm_70/Volta) with CUDA 12.8 — rebuilt daily when upstream releases
☆12Jul 22, 2026Updated 3 months ago
Alternatives and similar repositories for 1cat-vllm-v100-docker
Users that are interested in 1cat-vllm-v100-docker are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Stable, high-throughput inference server for multi-GPU NVIDIA V100 (SM70): Qwen3.8 Flash-Next with AWQ / NVFP4, multimodal input, CPU/dis…☆17Updated this week
- llama.cpp optimized for NVIDIA Tesla V100 (SM70): Qwen3.8-Flash-Next with MTP (prefill 3402 tok/s at 200K context on 6x V100-16GB; also r…☆61Updated this week
- ComfyUI MiniMax H3 inference optimizations for NVIDIA Tesla V100 (SM70)☆30Sep 29, 2026Updated last month
- Benchmarks and notes for running modern LLMs with vLLM on 8x Tesla V100-32GB in 2026.☆23Jul 10, 2026Updated 3 months ago
- A ComfyUI custom node enabling **Flash Attention 1** on legacy NVIDIA GPUs (Tesla V100, T4) that lack Compute Capability 8.0+ required by…☆33Feb 9, 2026Updated 8 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Third party commentaries for UniqueBible☆13Apr 8, 2021Updated 5 years ago
- SGLang for cool dudes using V100☆82Oct 5, 2026Updated 3 weeks ago
- NInfer on Tesla V100 (sm_70): Qwen3.8-27B deployment, build/convert scripts, systemd service, and cross-engine benchmark (vs llama.cpp). …☆52Sep 15, 2026Updated last month
- ComfyUI custom node: run MiniMax H3 at near-fp16 speed with near-fp32 numerical stability on GPUs without bf16/fp8 hardware (V100 sm_70)☆19Aug 22, 2026Updated 2 months ago
- Agentic-coding oriented inference engine for N x V100-SXM2, based on SGLang: GLM-5.3-Flash, Qwen3.8-Flash-Next, DeepSeek-V4.1-Flash, Mini…☆33Oct 7, 2026Updated 3 weeks ago
- CUDA-only Triton W8A8 block-FP8 kernel tuner for vLLM, with Qwen3 shape detection, custom shapes, and multi-GPU tuning.☆18Oct 7, 2026Updated 3 weeks ago
- DeepSeek V4 Flash 284B on AMD Strix Halo (gfx1151) — up to 32 tok/s decode & ~250 tok/s prefill via ROCmFPX, DSpark & ROCm 7.2☆19Aug 28, 2026Updated 2 months ago
- Serve your models fast on your own infra in 3 steps.☆39Updated this week
- Hand-written NVFP4 W4A16 CUDA kernels for Volta☆176Aug 19, 2026Updated 2 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ZFS port for Haiku.☆11Aug 20, 2011Updated 15 years ago
- Run local LLMs on a Tesla V100-SXM2-16GB: prebuilt binaries, serve scripts, and setup for Windows and Linux (Qwen3 + Gemma 4, Claude Code…☆17Sep 1, 2026Updated last month
- ☆26Updated this week
- Sol-Attn (arXiv 2607.24027) sparse acceleration for MiniMax H3 on V100 — single-node ComfyUI plugin (embedded FP16Safe + keep-or-drop ker…☆34Aug 29, 2026Updated 2 months ago
- Feature complete implementation of IEC870-5-103 protocol☆18Dec 12, 2022Updated 3 years ago
- forked from vllm-project/flash-attention☆70May 9, 2026Updated 5 months ago
- ☆11Feb 11, 2015Updated 11 years ago
- A Deepseek V4 Flash 0731 / Vision Exp VLLM stack☆26Sep 24, 2026Updated last month
- The wireless split keyboard firmware using ZMK has been optimized for E-ink screens and the Cirque trackpad.☆18Sep 17, 2026Updated last month
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Libegpu is a library for enumerating eGPU devices & enclosures.☆17Nov 24, 2025Updated 11 months ago
- A simple package to normalize email addresses by removing dots, stripping plus signs, and handling domain renaming.☆10Aug 10, 2024Updated 2 years ago
- Docker Compose for llama.cpp GGUF servers on AMD Strix Halo: Qwen, Gemma, and Laguna packages (abliterated and quantized), stock Vulkan p…☆27Aug 17, 2026Updated 2 months ago
- LF AI & Data Foundation related logos and artwork☆12Oct 22, 2026Updated last week
- ☆18Sep 26, 2026Updated last month
- marlin_v100 是一个从 vLLM 主树中提取出来的最小 Marlin 独立开发工作区，聚焦于 Marlin dense 与 Marlin MoE 的源码开发、最小构建和轻量验证。它保留了核心 CUDA/C++ 实现、最小 Python 薄封装、生成器测试与主树回写…☆26Jul 2, 2026Updated 3 months ago
- Firmware that drives the 2nd generation Afridev Sensor☆15May 7, 2021Updated 5 years ago
- classification tool for minor bodies using reflectance spectra and visual albedos☆20Feb 5, 2026Updated 8 months ago
- Qwen3.8-Flash-Next (W4A16) on 2x CMP 170HX: 110 tok/s decode, 7K prefill, 800 tok/s @ 23 concurrent - runs on 38 GB home RAM, no pinned m…☆20Sep 18, 2026Updated last month
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Toolkit for optimizing or building inference engines tailored to your hardware and desired LLM.☆36Updated this week
- An implemention of GraphRAG using open source small LLMs☆14Nov 9, 2024Updated last year
- Multiplatform serial communications library☆18Jun 5, 2025Updated last year
- A cmpunlocker fork with working p2p on SYS-4028GR-TRT2☆26Aug 8, 2026Updated 2 months ago
- The set-and-forget LLM engine for Pascal and Volta: PXQ codec + kernels, auto-tuned per card. Ready-to-run PXQ models in MODELS.md; bench…☆91Updated this week
- Free online SSH key generator. Generate Ed25519 & RSA keys securely in your browser. 100% client-side, open-source.☆20Oct 3, 2026Updated 3 weeks ago
- vLLM fork for Tesla V100☆15May 31, 2026Updated 4 months ago