vLLM optimized for AMD
☆28Nov 3, 2026Updated last week
Alternatives and similar repositories for vLLM_for_AMD
Users that are interested in vLLM_for_AMD are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This will be the official ROCmFPX stack and studio☆51Oct 17, 2026Updated 3 weeks ago
- Serving Qwen3.8-27B at ~140 tok/s on 2x AMD R9700 in a Proxmox VM — with working GPU P2P (emulated PCIe switch + XanMod kernel + NDEBUG R…☆21Sep 16, 2026Updated last month
- Halowin Bubo: gufo for native Windows with AMD HIP, tuned for Strix Halo laptops☆24Nov 4, 2026Updated last week
- NEW ROCmfp4 format for llama.cpp☆159Jun 13, 2026Updated 4 months ago
- ROCmFPX Family for AMD Hardware and Processors. More quants and special agent quants☆431Oct 22, 2026Updated 2 weeks ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Adversarial multi-model consensus protocol for Hermes Agent. Independent solve. Adversarial critique. Formal scoring. Verified synthesis.☆17Jul 16, 2026Updated 3 months ago
- OmaSeek: the Omarchy spirit and aesthetic. Now in DeepSeek Harness☆19Oct 31, 2026Updated last week
- dockerfiles, compose files, benchmarks for 2x R9700 serving☆27Oct 15, 2026Updated 3 weeks ago
- A set of performant RDNA/HIP patches against llama.cpp focusing on high speed inferencing with numerics assurance☆239Updated this week
- LLM inference in C/C++☆29Updated this week
- This repo contains the critical chat_template.jinja fix for Qwen3/3.5/3.6 to work smoothly in agentic task.☆95May 2, 2026Updated 6 months ago
- AMD Radeon 9700 AI PRO RDNA multi GPU Tools for llm/vLLM inference, tuning, overclocking, undervolting and LLM models benchmarking☆18Aug 15, 2026Updated 2 months ago
- Self-evolving AI assistant that learns, remembers, and acts on its own. Persistent vector memory, self-rewriting personality, proactive h…☆19Mar 21, 2026Updated 7 months ago
- RDNA-native LLM inference engine in Rust.☆807Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- LLM inference in C/C++☆43Updated this week
- dockerfiles, compose files, benchmarks for 2x R9700 serving☆65Updated this week
- Linux control center for NZXT Kraken AIO coolers — monitoring, fan/pump curves, LCD control, and RGB lighting via a reverse-engineered pr…☆22Nov 2, 2026Updated last week
- Rust LLM inference engine tuned for AMD Strix Halo (gfx1151): a fork of Strata with ggml/llama.cpp-derived HIP kernels. Five models on on…☆39Updated this week
- ☆15Oct 18, 2026Updated 3 weeks ago
- Index / recipe book for every GLM-5.3 (and GLM-5.2 foundation) serving recipe on NVIDIA DGX Spark (GB10): Flash + big 743B, TP2 + TP4, ev…☆14Aug 29, 2026Updated 2 months ago
- Kotai is a fully local, zero-cost voice assistant that combines the power of Kyutai TTS/STT, LiveKit, and local LLMs to create natural co…☆10Jul 14, 2025Updated last year
- WebFlux With R2DBC☆13Aug 5, 2020Updated 6 years ago
- ☆22Jan 14, 2026Updated 9 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Enhances Kokoro TTS output by merging segments with dynamic, programmable pauses for meditative or narrative flow.☆17Oct 16, 2025Updated last year
- CIRU llama.cpp runtime for Qwen3.8-Flash-CIRU-STRIX-IU4 on AMD Strix Halo☆22Updated this week
- From the world's largest port to the nation's first freeways to pioneering aqueducts, California's history has been defined by visionary …☆13Sep 17, 2026Updated last month
- Pure C wrapper library to use llama.cpp with Linux and Windows as simple as possible.☆16Sep 6, 2026Updated 2 months ago
- Source-only repair utility for one known RenoDX DLSS Neural Rendering STANDBY/FAILED signature error. No NVIDIA DLLs or downloads include…☆15Aug 28, 2026Updated 2 months ago
- Lightning-fast kernel dispatch for ROCm. Retained command replay over public ROCr/HSA queues.☆15Oct 11, 2026Updated last month
- ☆56Sep 1, 2026Updated 2 months ago
- vLLM fork for pascal gpu☆18Mar 13, 2026Updated 7 months ago
- SIA — the Omarchy Brain: a persistent, associative, self-consolidating memory for your Linux desktop. Local embeddings, typed knowledge g…☆32Oct 31, 2026Updated last week
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- A desktop companion for Hermes Agent — animated portraits, lip-synced TTS, reactive quips☆12Jun 28, 2026Updated 4 months ago
- Four ways to fake surface relief. Inspired by Crimson Desert☆17Aug 17, 2026Updated 2 months ago
- Private Strata customizations for 9950x3d2+dual 7900xtx; upstream Niko1221/Strata☆98Updated this week
- ☆20Sep 17, 2026Updated last month
- GPU + XDNA2 NPU inference for AMD Strix Halo (gfx1151): Qwen3.6-35B-A3B, Qwen3.8-27B, Qwen3.8 Flash-Next, Flint and GLM-5.3 Flash (321B M…☆94Updated this week
- Obsidian-powered daily logs, session logs, /prepforreset handoffs, and wiki janitor skills for AI agents.☆23Jul 29, 2026Updated 3 months ago
- The BigBlueButton-Bot interfaces with the platform's backend, enhancing user functionalities without a headless browser.☆13Feb 10, 2026Updated 9 months ago
Are these results useful?