Serving Qwen3.8-27B at ~140 tok/s on 2x AMD R9700 in a Proxmox VM — with working GPU P2P (emulated PCIe switch + XanMod kernel + NDEBUG RCCL) and DFlash2 speculative decoding
☆21Sep 16, 2026Updated 2 months ago
Alternatives and similar repositories for dual-r9700-vllm-proxmox
Users that are interested in dual-r9700-vllm-proxmox are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- dockerfiles, compose files, benchmarks for 2x R9700 serving☆27Nov 10, 2026Updated last week
- vLLM optimized for AMD☆28Nov 3, 2026Updated 2 weeks ago
- Codeberg fork of StillDeadcode / vllm-radiance which is a custom vllm tuned for R9700 GPU's☆172Nov 10, 2026Updated last week
- A Rust inference engine currently targeting AMD R9700 GPU's. buymeacoffee.com/bkuyper☆69Updated this week
- AMD R9700 Tuned Stack for vLLM and ROCM10☆40Nov 8, 2026Updated last week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- The fastest vLLM build for AMD R9700's. For the latest updates join the Launch80 discord server. I am on X now also https://x.com/bkuyp…☆195Oct 13, 2026Updated last month
- mDNS, SSDP/DIAL, WoL reflector☆13Updated this week
- ChatGPT-like AI that runs 100% locally on your hardware. No subscriptions, no cloud, complete privacy. Multi-agent swarm + 10 MCP tools +…☆11Feb 21, 2026Updated 8 months ago
- Extension for the pi agent that allows it to utilise agent shell to call other agentic harnesses as subagents☆12Oct 27, 2026Updated 3 weeks ago
- dockerfiles, compose files, benchmarks for 2x R9700 serving☆65Nov 9, 2026Updated last week
- Mark's pi coding agent harness for fully-local LM Studio models: 14 extensions (visual self-verification, gates, offline guard) + website…☆16Aug 10, 2026Updated 3 months ago
- Terminal-based context management for AI driven development☆22Oct 3, 2025Updated last year
- ☆10Apr 16, 2021Updated 5 years ago
- WebFlux With R2DBC☆13Aug 5, 2020Updated 6 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Modifications to the Orangestorm Giga to improve its usability, Modifications and reliability.☆14Nov 14, 2025Updated last year
- Let's tune the query comfortably! Revamping P6spy.☆17Aug 30, 2022Updated 4 years ago
- Container driven LLM control for VLLM & llama models☆14Updated this week
- Make Claude Code suggest the right skills and agents at the right time - automatically activate your custom workflows when they're most r…☆19Dec 4, 2025Updated 11 months ago
- Rocket.Chat platform plugin for Hermes Agent — install with: hermes plugins install HalfbitStudio/hermes-plugin-rocketchat☆18Nov 3, 2026Updated 2 weeks ago
- A set of performant RDNA/HIP patches against llama.cpp focusing on high speed inferencing with numerics assurance☆266Updated this week
- Tool Vault: An Integrated platform for AI agent tool management and security☆14Dec 17, 2025Updated 11 months ago
- ☆12Jan 2, 2025Updated last year
- Automated parameter sweep pipeline for finding optimal sampling settings for any local LLM on quantized weights☆22Feb 21, 2026Updated 8 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Probabilistic dice triggers for coding agents☆23Jul 23, 2026Updated 3 months ago
- An agent / harness multiplexer that allows you to access your agents from any device and machine☆23Updated this week
- Yggdrasil☆24Oct 16, 2025Updated last year
- A beautiful, yet simple service monitor that lives in your notch. Service Down? Your Notch will tell you! 👀☆25Feb 26, 2026Updated 8 months ago
- A solution to see live updating print progress through your phone's notification system (utilising live notifications in latest android r…☆13Aug 20, 2026Updated 2 months ago
- Tiny, Apache-2.0 wake-word detection you train yourself and run on-device in Python, the browser, and on mobile.☆16Sep 30, 2026Updated last month
- Blueprint for Zooz ZEN32 scene controller☆17Sep 27, 2026Updated last month
- A zero-dependency Python module for inspecting and converting coding-agent session files (.jsonl) — Claude Code, Codex, and Pi — into the…☆49Jul 10, 2026Updated 4 months ago
- flock cam detection☆13Nov 22, 2025Updated 11 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ☆13Oct 6, 2026Updated last month
- ☆210Oct 5, 2026Updated last month
- ☆27Aug 17, 2025Updated last year
- Modern self-hosting panel.☆15Jan 1, 2025Updated last year
- YouTrack CLI - Command line interface for JetBrains YouTrack issue tracking system☆29Nov 2, 2026Updated 2 weeks ago
- Instructions for enabling docker swarm support in unraid☆11Feb 16, 2019Updated 7 years ago
- Wyoming protocol server for Piper text to speech system☆12Oct 12, 2025Updated last year
Are these results useful?