vLLM fork for Tesla V100 (SM70) — extends 1CatAI's AWQ support and adds GGUF support
☆27Jun 20, 2026Updated 4 months ago
Alternatives and similar repositories for vllm-v100
Users that are interested in vllm-v100 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Implementation of FlashAttention-2 for Nvidia Tesla V100 / Titan V☆220Updated this week
- V100 / SM70-focused vLLM engineering fork for modern LLM inference.☆1,530Updated this week
- forked from vllm-project/flash-attention☆75May 9, 2026Updated 6 months ago
- 1Cat Studio: unified vLLM workbench, Codex Agent and creative canvas☆14Nov 6, 2026Updated last week
- ☆11Oct 18, 2026Updated 3 weeks ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Run AMD AITER's hand-written ASM kernels on CDNA2 / gfx90a (MI210, MI250). 242 of 1,422 kernels translated, with the tests and benchmarks…☆11Sep 9, 2026Updated 2 months ago
- VENDORIZED in lucebox-hub. Fork of llama.cpp, ggml graph for lucebox inference engine☆29Jul 8, 2026Updated 4 months ago
- vLLM fork for Tesla V100☆15May 31, 2026Updated 5 months ago
- 1Cat-vLLM on Intel Gaudi☆48Oct 12, 2026Updated last month
- Single-card Intel Gaudi2 vLLM source snapshot: FP8 Qwen, non-greedy DFlash2/MTP, GDN kernels and host-side optimizations.☆18Updated this week
- ☆10May 17, 2025Updated last year
- Tested recipes, runtime fixes, kernels and fleet practices for serving LLMs with vLLM on Intel Gaudi☆11Oct 25, 2026Updated 3 weeks ago
- Benchmarks and notes for running modern LLMs with vLLM on 8x Tesla V100-32GB in 2026.☆25Jul 10, 2026Updated 4 months ago
- PowerNPU: Fast On-device LLM Inference with NPUs [ASPLOS‘25]☆10Oct 18, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Modified sdr transciever for digital and analog modes include Tetra-TMO☆13Jun 22, 2026Updated 4 months ago
- Artifact source and scripts for the paper "Fast Local Page-Tables for Virtualized NUMA Servers with vMitosis"☆10Feb 17, 2021Updated 5 years ago
- CUDA engine that splits every layer of a production quality MoE LLM across three PCIe V100 cards delivering 382 tok/s on a used $1,800 bo…☆82Nov 7, 2026Updated last week
- Obleth is a high performance, fairshare AI gateway designed to be placed between the load balancer and an upstream provider like openai, …☆27Updated this week
- Tensor-Core selector unlock for RTX 4070 Ti Super☆29Oct 20, 2026Updated 3 weeks ago
- gEDA for Windows plus gSpiceUI☆18Jul 31, 2018Updated 8 years ago
- Simple "Oscilloscope" on CH32V003J4M6☆16Dec 17, 2024Updated last year
- 使用nvidia oam转接卡将intel gaudi2转接到pcie并在ubuntu下正常驱动和使用的指南☆31Nov 4, 2026Updated last week
- ☆21Aug 21, 2023Updated 3 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- OpenCode template with 10 MCP servers, 31+ agents (Next.js + Nuxt 4), 30+ commands, and 23 skills - fully configured and ready to use☆17Jan 15, 2026Updated 10 months ago
- [ISCA'25] LIA: A Single-GPU LLM Inference Acceleration with Cooperative AMX-Enabled CPU-GPU Computation and CXL Offloading☆12Jun 28, 2025Updated last year
- NInfer on Tesla V100 (sm_70): Qwen3.8-27B deployment, build/convert scripts, systemd service, and cross-engine benchmark (vs llama.cpp). …☆55Sep 15, 2026Updated 2 months ago
- This project is specifically developed for V100, based on lmdeploy 0.12.1, and supports mainstream open-source models from Q4 2025 to Q1 …☆22Mar 18, 2026Updated 7 months ago
- EBAZ4205 and AD9226 as a 0-32 MHz radio spectrum viewer☆17Dec 8, 2022Updated 3 years ago
- Dynamic LLM model swapping system with Docker, vLLM integration, and GPU acceleration. Supports GGUF & Hugging Face models with automatic…☆23Mar 6, 2026Updated 8 months ago
- marlin_v100 是一个从 vLLM 主树中提取出来的最小 Marlin 独立开发工作区,聚焦于 Marlin dense 与 Marlin MoE 的源码开发、最小构建和轻量验证。它保留了核心 CUDA/C++ 实现、最小 Python 薄封装、生成器测试与主树回写…☆27Jul 2, 2026Updated 4 months ago
- A zero-allocation, header-only C++ BPE tokenizer for Qwen, built for maximum inference throughput.☆24Apr 3, 2026Updated 7 months ago
- Portsdown 4 for the Raspberry Pi 4 with the official Raspberry Pi 7 inch touch screen. Digital amateur TV transmitter and receiver☆25Nov 1, 2026Updated 2 weeks ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Unified KV-cache compression for LLM inference: 12 Python-native methods, guarded add-on composition and routing, analytical capacity sim…☆30Oct 10, 2026Updated last month
- ☆19Jan 11, 2026Updated 10 months ago
- ☆25Updated this week
- 双 SM80 / CMP 170HX 的 Qwen3.8-Flash-Next 社区 vLLM:NVIDIA NVFP4、GDS、TEP2、MTP6,支持 1~10 并发,词表与 PCIe 通信优化。中英文部署与可构建源码。☆28Oct 15, 2026Updated last month
- A fuzzer for ML compilers☆47Aug 7, 2026Updated 3 months ago
- Alternative IP Camera firmware from an open community☆20Jan 22, 2026Updated 9 months ago
- ☆23Dec 12, 2024Updated last year
Are these results useful?