Benchmarks and notes for running modern LLMs with vLLM on 8x Tesla V100-32GB in 2026.
☆23Jul 10, 2026Updated 3 months ago
Alternatives and similar repositories for v100-vllm-2026
Users that are interested in v100-vllm-2026 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Block-FP8 (W8A16) on NVIDIA V100 / Volta (sm_70) for vLLM — the FP8 path upstream drops on Volta, tuned for sparse MoE.☆15Jul 10, 2026Updated 3 months ago
- Auto-built Docker image of 1Cat-vLLM for NVIDIA Tesla V100 (sm_70/Volta) with CUDA 12.8 — rebuilt daily when upstream releases☆12Jul 22, 2026Updated 3 months ago
- vLLM fork for Tesla V100☆15May 31, 2026Updated 5 months ago
- marlin_v100 是一个从 vLLM 主树中提取出来的最小 Marlin 独立开发工作区，聚焦于 Marlin dense 与 Marlin MoE 的源码开发、最小构建和轻量验证。它保留了核心 CUDA/C++ 实现、最小 Python 薄封装、生成器测试与主树回写…☆26Jul 2, 2026Updated 4 months ago
- Stable, high-throughput inference server for multi-GPU NVIDIA V100 (SM70): Qwen3.8 Flash-Next with AWQ / NVFP4, multimodal input, CPU/dis…☆48Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Fork of llama.cpp Nvida Volta V100 (tensor parallelism 4 x v100 GPU)☆12Updated this week
- A Simple Tool to gather information from any website, domain, sub-domain, DNS, links by enumeration with simple commands.☆18Jun 7, 2024Updated 2 years ago
- FlashAttention brought back to Tesla V100 — a deep llama.cpp fork: SM 7.0 D256 kernels, SplitKV3, q4_0 KV cache, DFlash2 speculative deco…☆19Updated this week
- Worm is an Android post exploitation Framework to gain remote access of any Android device by exploiting Android Debug Bridge.☆19Jun 7, 2024Updated 2 years ago
- a simple keylogger that records hardware inputs like keyboard, mouse, microphone and webcam and sends it to your e-mail.☆22Oct 18, 2024Updated 2 years ago
- Fast & lightweight interface for running Nano Banana LLM and compact local models on your PC. Optimized for high-speed AI interactions.☆44Mar 17, 2026Updated 7 months ago
- llama.cpp optimized for NVIDIA Tesla V100 (SM70). Qwen3.8-Flash-Next (MoE) with MTP on 1/2/3/6x V100-16GB at 262K context (6 GPUs: prefil…☆71Updated this week
- Qwen3.8-27B in native NVFP4/FP8 on 2x PCIe Tesla V100-32GB (SM70): the PCIe runbook for v100-skinny + 1Cat-vLLM, with the 3 fixes that ma…☆16Sep 13, 2026Updated last month
- ComfyUI custom node: run MiniMax H3 at near-fp16 speed with near-fp32 numerical stability on GPUs without bf16/fp8 hardware (V100 sm_70)☆19Aug 22, 2026Updated 2 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A simple package to normalize email addresses by removing dots, stripping plus signs, and handling domain renaming.☆10Aug 10, 2024Updated 2 years ago
- llama-cpp support turboquant and gemma 4☆20May 19, 2026Updated 5 months ago
- LF AI & Data Foundation related logos and artwork☆12Oct 29, 2026Updated last week
- SGLang for cool dudes using V100☆84Updated this week
- Open-source gravitational energy storage system. Converts potential energy into usable electricity using a chain-driven transmission, mag…☆11May 15, 2026Updated 5 months ago
- VENDORIZED in lucebox-hub. Fork of llama.cpp, ggml graph for lucebox inference engine☆29Jul 8, 2026Updated 3 months ago
- ☆16Oct 29, 2026Updated last week
- Agentic-coding oriented inference engine for N x V100-SXM2, based on SGLang: GLM-5.3-Flash, Qwen3.8-Flash-Next, DeepSeek-V4.1-Flash, Mini…☆35Oct 7, 2026Updated last month
- Last updated~ 26/03/2026 Old layouts can be viewed here - https://github.com/COUNTRY-HUMANS/old-readme & https://github.com/COUNTRY-HUMA…☆37Oct 10, 2026Updated 3 weeks ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- vLLM fork for Tesla V100 (SM70) — extends 1CatAI's AWQ support and adds GGUF support☆26Jun 20, 2026Updated 4 months ago
- ☆11Oct 29, 2018Updated 8 years ago
- A place to capture learnings about using my Sainsmart 3018 Pro CNC mill. Includes upgrades, tips & tricks, feeds and speeds for both mil…☆12May 18, 2025Updated last year
- ☆13Jun 27, 2025Updated last year
- Tools for classifying and analyzing animal ultrasonic vocalizations☆11Apr 30, 2013Updated 13 years ago
- Hand-written NVFP4 W4A16 CUDA kernels for Volta☆181Aug 19, 2026Updated 2 months ago
- Scalar is an open-source platform with: 🌐 Modern Rest API Client …☆10Oct 1, 2026Updated last month
- This repository implements the use of AI for robot tasks.☆15May 30, 2025Updated last year
- M5Stack LittlevGL MicroPython drivers☆11Feb 14, 2020Updated 6 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆14Mar 11, 2014Updated 12 years ago
- A browsable, searchable memory layer for Hermes AI agent conversations — automatically captured, summarized, and injected as context into…☆14May 29, 2026Updated 5 months ago
- ☆15May 21, 2026Updated 5 months ago
- ☆35Oct 20, 2025Updated last year
- This is the official **live** mirror of Huawei Ascend-native hardware plugin for ray☆16Oct 28, 2026Updated last week
- xllama.cpp — Optimized LLM Inference for NVidia Tesla V100-SXM2-32GB☆17Apr 29, 2026Updated 6 months ago
- ROS/MoveIt! extension for redundancy resolution with dynamic programming. Please cite: Ferrentino, E.; Salvioli, F.; Chiacchio, P. Global…☆11Mar 8, 2021Updated 5 years ago