Auto-built Docker image of 1Cat-vLLM for NVIDIA Tesla V100 (sm_70/Volta) with CUDA 12.8 — rebuilt daily when upstream releases
☆13Jul 22, 2026Updated 3 months ago
Alternatives and similar repositories for 1cat-vllm-v100-docker
Users that are interested in 1cat-vllm-v100-docker are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Stable, high-throughput inference server for multi-GPU NVIDIA V100 (SM70): Qwen3.8 Flash-Next with AWQ / NVFP4, multimodal input, CPU/dis…☆64Updated this week
- Fork of llama.cpp Nvida Volta V100 (tensor parallelism 4 x v100 GPU)☆12Updated this week
- Benchmarks and notes for running modern LLMs with vLLM on 8x Tesla V100-32GB in 2026.☆25Jul 10, 2026Updated 4 months ago
- ComfyUI MiniMax H3 inference optimizations for NVIDIA Tesla V100 (SM70)☆36Sep 29, 2026Updated last month
- llama.cpp optimized for NVIDIA Tesla V100 (SM70). Qwen3.8-Flash-Next (MoE) with MTP on 1/2/3/6x V100-16GB at 262K context (6 GPUs: prefil…☆83Nov 12, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Third party commentaries for UniqueBible☆13Apr 8, 2021Updated 5 years ago
- A ComfyUI custom node enabling **Flash Attention 1** on legacy NVIDIA GPUs (Tesla V100, T4) that lack Compute Capability 8.0+ required by…☆35Feb 9, 2026Updated 9 months ago
- Run Qwen3.8-Flash-Next on one AMD Strix Halo (Ryzen AI Max+ 395, gfx1151). EXL3 4.05 and 3.05 bpw packs, own ROCm/HIP kernels, OpenAI-com…☆33Updated this week
- 1Cat Studio: unified vLLM workbench, Codex Agent and creative canvas☆15Nov 6, 2026Updated last week
- Agentic-coding focused inference engine for n x V100 (e.g. SXM2), based on SGLang: GLM-5.3-Flash, Qwen3.8-Flash-Next, DeepSeek-V4.1-Flash…☆42Updated this week
- NInfer on Tesla V100 (sm_70): Qwen3.8-27B deployment, build/convert scripts, systemd service, and cross-engine benchmark (vs llama.cpp). …☆56Sep 15, 2026Updated 2 months ago
- Block-FP8 (W8A16) on NVIDIA V100 / Volta (sm_70) for vLLM — the FP8 path upstream drops on Volta, tuned for sparse MoE.☆15Jul 10, 2026Updated 4 months ago
- ComfyUI custom node: run MiniMax H3 at near-fp16 speed with near-fp32 numerical stability on GPUs without bf16/fp8 hardware (V100 sm_70)☆22Nov 10, 2026Updated last week
- SGLang for cool dudes using V100☆86Nov 11, 2026Updated last week
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ZFS port for Haiku.☆11Aug 20, 2011Updated 15 years ago
- Known-good vLLM recipe: Qwen3.8-27B-Int8 + MTP speculative decoding on NVIDIA CMP 170HX 64GB (Hynix) — 84 tok/s, 262k ctx☆13Oct 8, 2026Updated last month
- OrientDB driver for Python that uses the binary protocol.☆10Sep 1, 2023Updated 3 years ago
- Qwen3.8-Flash-Next (W4A16) on 2x NVIDIA CMP 170HX with vLLM pipeline parallel: 226 tok/s single-user, 840 tok/s at 8 users, 262K context,…☆12Nov 11, 2026Updated last week
- Easy recon tool for OSCP and HTB☆10Aug 8, 2024Updated 2 years ago
- CUDA-only Triton W8A8 block-FP8 kernel tuner for vLLM, with Qwen3 shape detection, custom shapes, and multi-GPU tuning.☆18Oct 7, 2026Updated last month
- ☆17Jun 10, 2026Updated 5 months ago
- ☆18Oct 26, 2026Updated 3 weeks ago
- Sol-Attn (arXiv 2607.24027) sparse acceleration for MiniMax H3 on V100 — single-node ComfyUI plugin (embedded FP16Safe + keep-or-drop ker…☆35Aug 29, 2026Updated 2 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- TrueNAS SCALE infrastructure provider for Sidero Omni — automatically provisions Talos Linux VMs via JSON-RPC 2.0☆12Oct 14, 2026Updated last month
- Feature complete implementation of IEC870-5-103 protocol☆18Dec 12, 2022Updated 3 years ago
- Run local LLMs on a Tesla V100-SXM2-16GB: prebuilt binaries, serve scripts, and setup for Windows and Linux (Qwen3 + Gemma 4, Claude Code…☆20Sep 1, 2026Updated 2 months ago
- Hand-written NVFP4 W4A16 CUDA kernels for Volta☆188Aug 19, 2026Updated 3 months ago
- ☆19Updated this week
- Fast vLLM on AMD Strix Halo: one docker command for Qwen, Gemma, LFM and more, up to 31x faster prefill and ~2x decode vs stock vLLM at l…☆22Nov 8, 2026Updated last week
- ☆11Feb 11, 2015Updated 11 years ago
- Exact LLM inference engine written from scratch for AMD Strix Halo (gfx1151, ROCm/HIP). Qwen3.8-Flash-Next on one node or two replicas; D…☆35Updated this week
- A simple package to normalize email addresses by removing dots, stripping plus signs, and handling domain renaming.☆10Aug 10, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Open firmware for the Flashforge Adventurer 5X (AD5X): Klipper, Fluidd and touch screen, with a recovery system.☆27Updated this week
- LF AI & Data Foundation related logos and artwork☆12Updated this week
- DeepSeek V4 Flash 284B on AMD Strix Halo (gfx1151) — up to 32 tok/s decode & ~250 tok/s prefill via ROCmFPX, DSpark & ROCm 7.2☆21Aug 28, 2026Updated 2 months ago
- Firmware that drives the 2nd generation Afridev Sensor☆15May 7, 2021Updated 5 years ago
- classification tool for minor bodies using reflectance spectra and visual albedos☆21Feb 5, 2026Updated 9 months ago
- forked from vllm-project/flash-attention☆75May 9, 2026Updated 6 months ago
- Libegpu is a library for enumerating eGPU devices & enclosures.☆16Nov 24, 2025Updated 11 months ago
Are these results useful?