Codeberg fork of StillDeadcode / vllm-radiance which is a custom vllm tuned for R9700 GPU's
☆159Oct 18, 2026Updated 2 weeks ago
Alternatives and similar repositories for vllm-radiance
Users that are interested in vllm-radiance are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The fastest vLLM build for AMD R9700's. For the latest updates join the Launch80 discord server. I am on X now also https://x.com/bkuyp…☆192Oct 13, 2026Updated 3 weeks ago
- Shape-specialized ROCm inference for Qwen3.8 Flash Next on RDNA4☆69Sep 25, 2026Updated last month
- Working on the fastest vllm path for AMD Radeon AI PRO R9700☆107Updated this week
- AMD R9700 Tuned Stack for vLLM and ROCM10☆39Updated this week
- ☆113Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Guide for running vLLM with tensor parallelism (TP=2) on dual AMD Radeon AI PRO R9700 GPUs☆20Jun 21, 2026Updated 4 months ago
- Serving Qwen3.8-27B at ~140 tok/s on 2x AMD R9700 in a Proxmox VM — with working GPU P2P (emulated PCIe switch + XanMod kernel + NDEBUG R…☆21Sep 16, 2026Updated last month
- A set of performant RDNA/HIP patches against llama.cpp focusing on high speed inferencing with numerics assurance☆235Updated this week
- dockerfiles, compose files, benchmarks for 2x R9700 serving☆27Oct 15, 2026Updated 3 weeks ago
- An RDNA4 R9700 AI Pro ComfyUI patch for MiniMax H3 to speed up video generation.☆33Aug 8, 2026Updated 2 months ago
- AMD Radeon 9700 AI PRO RDNA multi GPU Tools for llm/vLLM inference, tuning, overclocking, undervolting and LLM models benchmarking☆17Aug 15, 2026Updated 2 months ago
- Real-world percentile benchmark for LLM inference servers: 1% A/B resolution, offline HTML reports. I am now on X also: https://x.com/bku…☆76Oct 9, 2026Updated 3 weeks ago
- Portable vLLM builds with AMD ROCm acceleration for Lemonade☆81Sep 9, 2026Updated last month
- TypeScript AI agent framework where personality is architecture. Specialists, not chatbots.☆22Updated this week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- 把 Codex 原版 computer-use 运行时做成一个普通命令行工具。☆16Oct 28, 2026Updated last week
- Validate the usable size of your local LLM cache under pressure☆12Sep 26, 2026Updated last month
- vLLM optimized for AMD☆28Updated this week
- ☆14Aug 25, 2024Updated 2 years ago
- FlashAttention-style custom attention backend for vLLM on AMD MI50/MI60/Radeon VII (gfx906). Downstream fork of mixa3607/ML-gfx906 with r…☆17Apr 22, 2026Updated 6 months ago
- ☆22Jan 14, 2026Updated 9 months ago
- A very-low-resource API-compatible replacement for Ray☆13Updated this week
- ☆49Oct 21, 2026Updated 2 weeks ago
- RDNA-native LLM inference engine in Rust.☆800Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- vLLM + Qwen3.6-27B (BF16) OpenAI-compatible inference server on AMD Strix Halo (Ryzen AI Max+ 395, gfx1151). Vision input, 256K context, …☆18Apr 26, 2026Updated 6 months ago
- ROCmFPX Family for AMD Hardware and Processors. More quants and special agent quants☆432Oct 22, 2026Updated 2 weeks ago
- Random AI notes for working with local models or playing around with random machine learning bits.☆63Jun 7, 2026Updated 5 months ago
- A lightweight CLI tool for RAG over local documents☆34Sep 11, 2026Updated last month
- The Open Source Strix Halo AI engine. Qwen 3.8 Flash Next Q4_K_XL: 1,801.01 pp, 73.17 tg single user, 194.37 tok/s 8 users; Qwen 3.8 27B…☆1,093Updated this week
- A frontier model edits another model's weights by hand (Gemma 4 12B, EN->IT tense). Plus an awareness experiment: tampering Qwen3.8-27B i…☆23Updated this week
- vLLM Qwen 3.6-27B (AWQ-INT4) + DFlash speculative decoding on AMD Strix Halo (gfx1151 iGPU, 128 GB UMA, ROCm 7.13). 24.8 t/s single-strea…☆53May 10, 2026Updated 5 months ago
- vLLM 0.33 fork for consumer GPUs: 3 x 262K sessions on 4x RTX 3090, Qwen 3.8 Flash-Next at 207 tok/s, up to 17 on bigger cards. Seven che…☆45Updated this week
- Extension for the pi agent that allows it to utilise agent shell to call other agentic harnesses as subagents☆11Oct 27, 2026Updated last week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- 使用nvidia oam转接卡将intel gaudi2转接到pcie并在ubuntu下正常驱动和使用的指南☆29Updated this week
- Unofficial community mobile client for the DeepSeek Harness Web UI.☆19Updated this week
- Fastest MoE/LLM inference runtime for consumer and edge Blackwell GPUs. SN74 on Gittensor.☆93Oct 11, 2026Updated 3 weeks ago
- English guide + one-command patcher for the vLLM spin-wait bug that overheats NVIDIA DGX Spark / GB10. Credit: nacyot. CPU cores spin at …☆24Aug 17, 2026Updated 2 months ago
- Rust CLI for RBMEM (.rbmem), a structured Rust-Brain memory format with timestamp-protected sections, hierarchy, graph relations, Hermes …☆29Oct 18, 2026Updated 2 weeks ago
- Give Hermes lighter sandals. In Greek myth, Talaria are the winged sandals of Hermes, the messenger god. They are what let him move quic…☆13May 3, 2026Updated 6 months ago
- Local Research Agent , uses Ollama as inference engine. Embedding model for semantic matching of topics for better reports. Prints report…☆13Jan 9, 2026Updated 9 months ago