A high-throughput and memory-efficient inference and serving engine for LLMs - Optimized for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60
☆95Oct 8, 2026Updated last month
Alternatives and similar repositories for vllm-gfx906-mobydick
Users that are interested in vllm-gfx906-mobydick are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ML software (llama.cpp, ComfyUI, Strata, Maya, ...) builds for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60☆383Nov 6, 2026Updated last week
- LLM inference in C/C++☆77Nov 6, 2026Updated last week
- llama.cpp-gfx906☆150Aug 23, 2026Updated 2 months ago
- vLLM for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60☆52Updated this week
- Builds vLLM for ROCm gfx906 using Nix☆18Aug 29, 2026Updated 2 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- vLLM for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60☆436Feb 20, 2026Updated 8 months ago
- Optimized build of llama.cpp for gfx906/Vega20.☆25Updated this week
- Flash-attention-class memory efficiency for GPUs without flash attention☆12Mar 28, 2026Updated 7 months ago
- FlashAttention-style custom attention backend for vLLM on AMD MI50/MI60/Radeon VII (gfx906). Downstream fork of mixa3607/ML-gfx906 with r…☆19Apr 22, 2026Updated 6 months ago
- triton for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60☆48Dec 8, 2025Updated 11 months ago
- Guidances for Test setup of 8 AMD MI50 32GB (LLM)☆14Oct 22, 2025Updated last year
- ☆32Sep 30, 2026Updated last month
- A database of knowledge around inference & training on GFX906 GPUs https://skyne98.github.io/wiki-gfx906/☆19Feb 21, 2026Updated 8 months ago
- 🚿 Llaminar: an LLM inferencing engine in C++.☆48Updated this week
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Custom HIP inference engine for AMD MI50/MI60 (gfx906)☆20Oct 4, 2026Updated last month
- Open-source local AI server configs, GFX906 runtime maintenance, reproducible benchmarks, and QC methods for affordable AI research infra…☆17Jul 1, 2026Updated 4 months ago
- vLLM for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60☆11Apr 2, 2026Updated 7 months ago
- Modified for AMD MI50 GPUs | A high-throughput and memory-efficient inference and serving engine for LLMs☆15Mar 2, 2026Updated 8 months ago
- gfx906 setup document☆14Sep 1, 2025Updated last year
- Strata 0.2.3 (engine 0.1.48) for AMD gfx906 (MI50/MI60/Radeon VII): rocBLAS solution table, Qwen3.6/Ornith engine restored, DFlash2 build…☆27Nov 1, 2026Updated last week
- ☆28May 22, 2026Updated 5 months ago
- Unlock tool for the NVIDIA CMP 170HX (GA100) mining card. Restores full A100 compute throughput by exploiting the Falcon BootROM .fwsigna…☆57Jul 30, 2026Updated 3 months ago
- Guidances for Test setup of 8 AMD MI50 32GB (for GLM 4.7 and MiniMax-M2.1)☆15Feb 24, 2026Updated 8 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆30Oct 7, 2026Updated last month
- vllm for pascal☆12Nov 22, 2025Updated 11 months ago
- triton3.2.0添加mi25/mi50/mi60支持☆14Apr 26, 2025Updated last year
- NInfer SM80 port for NVIDIA CMP 170HX☆29Aug 22, 2026Updated 2 months ago
- some experiments about 170hx 10g version.☆11Oct 19, 2026Updated 3 weeks ago
- Container driven LLM control for VLLM & llama models☆14Updated this week
- A tool for parsing, dumping and modifying data in Radeon PowerPlay tables☆199Mar 15, 2025Updated last year
- INT8-native vLLM fork☆28Updated this week
- HRX, LOOM, Mac, and AMD running top speed kernels with a self optimizing engine.☆35Oct 12, 2026Updated last month
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- glm-5.2 on too many 64 / 80 GB A100's☆22Sep 9, 2026Updated 2 months ago
- Guidances for Test setup of 16 AMD MI50 32GB (for Deepseek v3.2)☆29May 11, 2026Updated 6 months ago
- Shape-specialized ROCm inference for Qwen3.8 Flash Next on RDNA4☆69Sep 25, 2026Updated last month
- The main repository for building Pascal-compatible versions of ML applications and libraries.☆221Aug 23, 2025Updated last year
- Strata port for Tesla V100 (sm_70): Qwen3.8-Flash-Next with 262K context and MTP☆143Updated this week
- llama.cpp with Mirai S (2.4-bit Qwen3.8-27B) support: 128K context on a 12 GB GPU☆11Oct 7, 2026Updated last month
- An agent that builds agents — closed-loop AI system that interviews, designs, tests, and ships standalone Python agents.☆14Jul 29, 2026Updated 3 months ago
Are these results useful?