vLLM fork for Tesla V100 (SM70) — extends 1CatAI's AWQ support and adds GGUF support
☆26Jun 20, 2026Updated 4 months ago
Alternatives and similar repositories for vllm-v100
Users that are interested in vllm-v100 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- V100 / SM70-focused vLLM engineering fork for modern LLM inference.☆1,392Updated this week
- forked from vllm-project/flash-attention☆69May 9, 2026Updated 5 months ago
- Linux driver for Realtek USB FE / GBE / 2.5G / Gaming Ethernet Family Controller Software: RTL8152B, RTL8153/RTL8153B, RTL8154/RTL8154B, …☆10Jul 15, 2024Updated 2 years ago
- NInfer on Tesla V100 (sm_70): Qwen3.8-27B deployment, build/convert scripts, systemd service, and cross-engine benchmark (vs llama.cpp). …☆51Sep 15, 2026Updated last month
- [ISCA'25] LIA: A Single-GPU LLM Inference Acceleration with Cooperative AMX-Enabled CPU-GPU Computation and CXL Offloading☆12Jun 28, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆17Jun 4, 2026Updated 4 months ago
- llama-cpp support turboquant and gemma 4☆20May 19, 2026Updated 5 months ago
- ☆22Sep 28, 2026Updated 3 weeks ago
- Full-featured Android Debug Bridge MCP server — 209 tools across 49 modules, 5 resources, and 4 prompts, from UI to baseband.☆20Updated this week
- TeamCopilot: Deploy AI agents for your team to automate business workflows and coding.☆17Jun 23, 2026Updated 4 months ago
- gEDA for Windows plus gSpiceUI☆18Jul 31, 2018Updated 8 years ago
- ☆14Mar 29, 2019Updated 7 years ago
- 双 SM80 / CMP 170HX 的 Qwen3.8-Flash-Next 社区 vLLM：NVIDIA NVFP4、GDS、TEP2、MTP6，支持 1～10 并发，词表与 PCIe 通信优化。中英文部署与可构建源码。☆28Oct 15, 2026Updated last week
- Dynamic LLM model swapping system with Docker, vLLM integration, and GPU acceleration. Supports GGUF & Hugging Face models with automatic…☆23Mar 6, 2026Updated 7 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- A ComfyUI custom node enabling **Flash Attention 1** on legacy NVIDIA GPUs (Tesla V100, T4) that lack Compute Capability 8.0+ required by…☆32Feb 9, 2026Updated 8 months ago
- SGLang for cool dudes using V100☆80Oct 5, 2026Updated 3 weeks ago
- ☆25Updated this week
- Unified KV-cache compression for LLM inference: 12 Python-native methods, guarded add-on composition and routing, analytical capacity sim…☆29Oct 10, 2026Updated 2 weeks ago
- A zero-allocation, header-only C++ BPE tokenizer for Qwen, built for maximum inference throughput.☆24Apr 3, 2026Updated 6 months ago
- Local benchmarking UI for LLMs and AI agents☆25Apr 13, 2026Updated 6 months ago
- Portsdown 4 for the Raspberry Pi 4 with the official Raspberry Pi 7 inch touch screen. Digital amateur TV transmitter and receiver☆25Oct 18, 2026Updated last week
- 1Cat-vLLM on Intel Gaudi☆43Oct 12, 2026Updated last week
- Superseded by github.com/poisonxa16/pxa — PXA, the set-and-forget engine for Pascal and Volta☆24Sep 8, 2026Updated last month
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Stop prompting your agents to behave. Start engineering them to.☆26Apr 17, 2026Updated 6 months ago
- ☆23Dec 12, 2024Updated last year
- Code Library for Arduino system based development tool☆20Feb 15, 2025Updated last year
- Repo for ECHO: Efficient KV Cache Offloading with Lossless Prefetching for Serving Native Sparse Attention LLMs (OSDI'26)☆39Jul 12, 2026Updated 3 months ago
- You can run passively cooled single slot Tesla GPU/KI cards in a HP Proliant with a modified iLO ROM that take care of the fan and conseq…☆26Dec 16, 2025Updated 10 months ago
- A high-performance, memory-efficient inference server for diffusion models (image/video generation), compatible with the OpenAI client☆28Sep 24, 2026Updated last month
- Force any Model, VAE, or CLIP to any GPU or CPU—and keep it there (or don't).☆36Feb 6, 2026Updated 8 months ago
- My playground. Currently used as an auto builder for some custom board configs. EXPERIMENTAL CHANGES WARNING☆24Jan 2, 2025Updated last year
- An improved XLX reflector☆23Jul 30, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Distributed AI/HPC Monitoring Framework☆29Apr 11, 2025Updated last year
- Redis 3.0.504 modified to run on 32-bit Windows XP and 2003☆14Nov 25, 2024Updated last year
- ☆82Updated this week
- Dual channel Arduino Nano milliwatt power meter for HF/VHF/UHF/SHF bands☆30Nov 1, 2024Updated last year
- Low cost, low part count CH32V003-based oscilloscope☆29Dec 27, 2025Updated 9 months ago
- 🤵 AIfred-Intelligence — self-hosted multi-agent assistant: debate modes (Symposion/Tribunal), voice (STT + streaming TTS, voice cloning)…☆39Updated this week
- [ISCA'25] LIA: A Single-GPU LLM Inference Acceleration with Cooperative AMX-Enabled CPU-GPU Computation and CXL Offloading☆26Jan 6, 2026Updated 9 months ago