Benchmarks and notes for running modern LLMs with vLLM on 8x Tesla V100-32GB in 2026.
☆23Jul 10, 2026Updated 3 months ago
Alternatives and similar repositories for v100-vllm-2026
Users that are interested in v100-vllm-2026 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The set-and-forget LLM engine for Pascal and Volta: PXQ codec + kernels, auto-tuned per card. Ready-to-run PXQ models in MODELS.md; bench…☆85Updated this week
- Fast & lightweight interface for running Nano Banana LLM and compact local models on your PC. Optimized for high-speed AI interactions.☆43Mar 17, 2026Updated 7 months ago
- Home Assistant voice stack integration for Hermes Agent — on-device voice control, wake word → STT → LLM → TTS → HA media_player. No clou…☆79Sep 23, 2026Updated 3 weeks ago
- LF AI & Data Foundation related logos and artwork☆11Oct 8, 2026Updated last week
- A simple package to normalize email addresses by removing dots, stripping plus signs, and handling domain renaming.☆10Aug 10, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- SGLang for cool dudes using V100☆79Oct 5, 2026Updated last week
- Velocity Local Services: an app for running LLMs locally on Windows and Linux. Load any GGUF model and chat with web search, tools and sc…☆32Updated this week
- Everyday docker compose files☆12Feb 1, 2026Updated 8 months ago
- Hand-written NVFP4 W4A16 CUDA kernels for Volta☆175Aug 19, 2026Updated last month
- Open-source desktop AI agent that sees what you see — one hotkey over any window, it answers, acts, or guides you step-by-step.☆41Oct 10, 2026Updated last week
- Zero-cost LLM routing across free-tier model APIs with Bifrost, certification scripts, and agent-ready fallback chains☆55Jun 11, 2026Updated 4 months ago
- Strata port for Tesla V100 (sm_70): Qwen3.8-Flash-Next with 262K context and MTP☆76Updated this week
- ☆13Jun 27, 2025Updated last year
- Real-world percentile benchmark for LLM inference servers: 1% A/B resolution, offline HTML reports. I am now on X also: https://x.com/bku…☆67Oct 9, 2026Updated last week
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- CPU-optimized LLM inference engine (C)☆48Updated this week
- 把健保「健康存摺」與 Apple 健康的下載檔，整理成可累積、可搜尋、可帶去回診討論的本機家庭健康紀錄。全程本機、不需帳號、不上雲。macOS／Windows 桌面 App。☆98Oct 8, 2026Updated last week
- marlin_v100 是一个从 vLLM 主树中提取出来的最小 Marlin 独立开发工作区，聚焦于 Marlin dense 与 Marlin MoE 的源码开发、最小构建和轻量验证。它保留了核心 CUDA/C++ 实现、最小 Python 薄封装、生成器测试与主树回写…☆26Jul 2, 2026Updated 3 months ago
- Intel Wi-Fi Drivers for macOS☆138Updated this week
- An environment where open models work as agents: a first-level harness with routing, skills, memory and sandboxed tools, on an engine tha…☆54Updated this week
- ☆14Mar 11, 2014Updated 12 years ago
- ☆15Aug 25, 2026Updated last month
- This is simple GitHub copilot prometheus metrics exporter☆12Apr 9, 2026Updated 6 months ago
- Ethiopian Literature edited in TEI☆10Oct 6, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Tools for working with KDZ files (LG's Android device upgrade format)☆11Jan 7, 2021Updated 5 years ago
- Lidgren.Network Reimagined; Networking library for .NET☆16Mar 22, 2024Updated 2 years ago
- V100 / SM70-focused vLLM engineering fork for modern LLM inference.☆1,350Updated this week
- A simple Google Chrome browser extension to render JSON response from a web url as a table☆15Oct 16, 2022Updated 4 years ago
- ☆14Mar 22, 2020Updated 6 years ago
- A complete Codex theme platform for browsing, AI creation, custom themes, community publishing and creator rewards.☆136Aug 28, 2026Updated last month
- Better and open source replacement for DriveDroid☆21Apr 14, 2024Updated 2 years ago
- ☆47Sep 13, 2026Updated last month
- ADBC Client for DuckDB☆48Updated this week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆163Updated this week
- Transaction scoring demo with RedisAI☆18May 15, 2024Updated 2 years ago
- Slide is an open-source, ad-free Reddit browser for Android.☆16May 31, 2024Updated 2 years ago
- Simple project to export ASUS Traffic Analyzer data from router to an Influx database for offboard analysis/visualisation☆15Aug 6, 2023Updated 3 years ago
- Spark Example using Phoenix to interact with HBase☆16Nov 2, 2016Updated 9 years ago
- ☆10Aug 18, 2025Updated last year
- OnePlus 6/6T Kernel 4.19 Source with some additional features like Overclock GPU,KernelSU,multigenerational LRU {mglru},lxc,docker like f…☆13Aug 12, 2024Updated 2 years ago