Working on the fastest vllm path for AMD Radeon AI PRO R9700
☆107Nov 8, 2026Updated this week
Alternatives and similar repositories for vllm-sly-radiance
Users that are interested in vllm-sly-radiance are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Qwen3.8-27B via vLLM on a single AMD Radeon AI PRO R9700 (gfx1201, 32 GiB) — bare, script-free setup guide, written to be executed by an …☆13Sep 3, 2026Updated 2 months ago
- ☆114Updated this week
- The fastest vLLM build for AMD R9700's. For the latest updates join the Launch80 discord server. I am on X now also https://x.com/bkuyp…☆193Oct 13, 2026Updated 3 weeks ago
- Codeberg fork of StillDeadcode / vllm-radiance which is a custom vllm tuned for R9700 GPU's☆161Oct 18, 2026Updated 3 weeks ago
- WHIRL (Windows HIP Inference for RDNA LLMs): native Windows C++/HIP LLM inference engine for the AMD Ryzen AI Max+ 395 (Radeon 8060S) and…☆37Updated this week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆49Oct 21, 2026Updated 2 weeks ago
- Real-world percentile benchmark for LLM inference servers: 1% A/B resolution, offline HTML reports. I am now on X also: https://x.com/bku…☆80Oct 9, 2026Updated 3 weeks ago
- An RDNA4 R9700 AI Pro ComfyUI patch for MiniMax H3 to speed up video generation.☆33Aug 8, 2026Updated 3 months ago
- A set of performant RDNA/HIP patches against llama.cpp focusing on high speed inferencing with numerics assurance☆237Updated this week
- AMD R9700 Tuned Stack for vLLM and ROCM10☆39Updated this week
- vLLM on AMD RDNA4 (gfx1201 / RX 9070 XT-9070): clone-and-docker-compose-up, with a W4A8-FP8-WMMA MoE kernel☆14Jul 18, 2026Updated 3 months ago
- AMD Radeon 9700 AI PRO RDNA multi GPU Tools for llm/vLLM inference, tuning, overclocking, undervolting and LLM models benchmarking☆17Aug 15, 2026Updated 2 months ago
- Almond: a multi-model MoE engine for AMD RX 7900 XTX (ROCm/HIP) - DeepSeek-V4.1-Flash, GLM-5.3-Flash, Qwen3.8-Flash-Next☆53Updated this week
- A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative…☆11Oct 13, 2026Updated 3 weeks ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- LLM inference in C/C++☆29Updated this week
- ☆13Sep 22, 2026Updated last month
- ☆36Updated this week
- Portable vLLM builds with AMD ROCm acceleration for Lemonade☆81Sep 9, 2026Updated last month
- A Rust inference engine currently targeting AMD R9700 GPU's. buymeacoffee.com/bkuyper☆53Updated this week
- ☆211Oct 5, 2026Updated last month
- Run Hermes Agent + Claude Code locally on llama.cpp — zero API costs. A 4h / 7M-token session that would have cost $94 on Claude Opus 4.7☆32Oct 5, 2026Updated last month
- Shape-specialized ROCm inference for Qwen3.8 Flash Next on RDNA4☆69Sep 25, 2026Updated last month
- ☆12Nov 1, 2026Updated last week
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Model Context Protocol (MCP) server for OCI Documentation☆12May 20, 2026Updated 5 months ago
- ROCmFPX Family for AMD Hardware and Processors. More quants and special agent quants☆431Oct 22, 2026Updated 2 weeks ago
- ☆18Oct 2, 2026Updated last month
- Give Hermes lighter sandals. In Greek myth, Talaria are the winged sandals of Hermes, the messenger god. They are what let him move quic…☆13May 3, 2026Updated 6 months ago
- Linux & Powershell scripts to easily set up and run the Qwen 3.5 series locally on Windows and Linux with llama.cpp.☆114Updated this week
- Qwen3.8-27B EXL3 + DFlash2 speculative decoding on an AMD RX 7900 XTX (exllamav3-rocm): recipe, patches, benchmarks☆22Nov 2, 2026Updated last week
- Repo with guide and assets to follow the 2026 CND Romania workshop: Observability unlocked with OpenTelemetry and the VictoriaMetrics Sta…☆17Jul 31, 2026Updated 3 months ago
- ☆16Apr 27, 2026Updated 6 months ago
- PhotonOS Harbor Packer reference implementation (OVA)☆18Aug 2, 2022Updated 4 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- WikiPBX is an open source PBX web interface for FreeSWITCH. WikiPBX is written in python and uses the Django web application framework. C…☆10May 30, 2014Updated 12 years ago
- Plugin module for MMM-CalendarExt and MMM-CalendarExt2, to display schedule plan.☆11Jul 7, 2026Updated 4 months ago
- NPU-accelerated speech transcription & speaker diarization on AMD Strix Halo: Whisper-v3-turbo on XDNA 2 + pyannote, OpenAI-compatible AP…☆14Aug 31, 2026Updated 2 months ago
- Pixelmator Pro image format (.pxd) library☆11Feb 5, 2023Updated 3 years ago
- Проект посвящённый развитию в SRE направлении☆17Updated this week
- iRules for F5 TMOS☆13Oct 9, 2026Updated 3 weeks ago
- The all-in-one AI assistant for development and content creation☆16Aug 12, 2026Updated 2 months ago