llama.cpp-gfx906
☆149Aug 23, 2026Updated 2 months ago
Alternatives and similar repositories for llama.cpp-gfx906
Users that are interested in llama.cpp-gfx906 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A high-throughput and memory-efficient inference and serving engine for LLMs - Optimized for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI…☆94Oct 8, 2026Updated 3 weeks ago
- ML software (llama.cpp, ComfyUI, Strata, Maya, ...) builds for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60☆376Updated this week
- vLLM for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60☆436Feb 20, 2026Updated 8 months ago
- LLM inference in C/C++☆75Updated this week
- triton for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60☆48Dec 8, 2025Updated 10 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Optimized build of llama.cpp for gfx906/Vega20.☆24Updated this week
- Custom HIP inference engine for AMD MI50/MI60 (gfx906)☆19Oct 4, 2026Updated last month
- ☆30May 12, 2026Updated 5 months ago
- 🚿 Llaminar: an LLM inferencing engine in C++.☆47Updated this week
- Builds vLLM for ROCm gfx906 using Nix☆18Aug 29, 2026Updated 2 months ago
- vLLM for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60☆50Oct 28, 2026Updated last week
- ☆32Sep 30, 2026Updated last month
- Strata 0.2.3 (engine 0.1.48) for AMD gfx906 (MI50/MI60/Radeon VII): rocBLAS solution table, Qwen3.6/Ornith engine restored, DFlash2 build…☆23Updated this week
- ☆28Oct 7, 2026Updated last month
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Profile-guided GPU kernel optimizer for AMD/RDNA3. Auto-tunes llama.cpp MMVQ kernels per model shape. 2x decode speedup on 7900 XTX.☆71Sep 5, 2026Updated 2 months ago
- A database of knowledge around inference & training on GFX906 GPUs https://skyne98.github.io/wiki-gfx906/☆19Feb 21, 2026Updated 8 months ago
- Guidances for Test setup of 8 AMD MI50 32GB (LLM)☆14Oct 22, 2025Updated last year
- FORK of VLLM for AMD MI25/50/60. A high-throughput and memory-efficient inference and serving engine for LLMs☆71May 4, 2025Updated last year
- ☆107Dec 29, 2020Updated 5 years ago
- RDNA-native LLM inference engine in Rust.☆804Updated this week
- INT8-native vLLM fork☆28Updated this week
- Open-source local AI server configs, GFX906 runtime maintenance, reproducible benchmarks, and QC methods for affordable AI research infra…☆17Jul 1, 2026Updated 4 months ago
- ☆28May 22, 2026Updated 5 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- High-performance batched Top-K selection for CPU inference. Up to 80x faster than PyTorch, optimized for LLM sampling with AVX2 SIMD.☆18Mar 20, 2026Updated 7 months ago
- vLLM for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60☆11Apr 2, 2026Updated 7 months ago
- Qwen3.8-27B and Qwen3.6-35B-A3B local inference engine for Vulkan and Metal☆79Updated this week
- Sherpa-onnx-tts-stt source for homeassisstant addon with Kroko Onnx Streaming STT integration.☆32Dec 18, 2025Updated 10 months ago
- llama.cpp fork with additional SOTA quants and improved performance☆3,381Updated this week
- Open source cooling solution for the **AMD Radeon Instinct MI50** (Vega 20).☆18May 29, 2026Updated 5 months ago
- This is a repository for documenting the setup and performance of MI100s in popular inference engines.☆20Oct 8, 2026Updated 3 weeks ago
- An attempt to use Nvidia CMP cards for Machine Learning.☆33Jun 14, 2026Updated 4 months ago
- Run AMD AITER's hand-written ASM kernels on CDNA2 / gfx90a (MI210, MI250). 242 of 1,422 kernels translated, with the tests and benchmarks…☆11Sep 9, 2026Updated last month
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A general-purpose LLM harness and coding agent implemented as a single, hackable Bash script.☆12Updated this week
- Thireus's fork of llama.cpp with Cuda 12.8 and 13.4 release builds and Windows patch for loading more .gguf shards + llama-sweep-bench☆30Oct 19, 2026Updated 2 weeks ago
- OpenMOSS pure C++ pipeline based on GGML☆76Sep 24, 2026Updated last month
- A simple no-install web UI for Ollama and OAI-Compatible APIs!☆31Jan 30, 2025Updated last year
- Next generation PowerPC library for classic AmigaOS (work in progress)☆13Feb 5, 2024Updated 2 years ago
- A llamacpp wrapper to manage and monitor your llama server instance over a web ui.☆33Jun 16, 2026Updated 4 months ago
- Fresh builds of llama.cpp with AMD ROCm™ acceleration☆809Updated this week