AI Inferencing at the Edge. A simple one-file way to run various GGML models with KoboldAI's UI with AMD ROCm offloading
☆779Jul 29, 2026Updated 3 months ago
Alternatives and similar repositories for koboldcpp-rocm
Users that are interested in koboldcpp-rocm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- KoboldCpp - Run GGUF AI models locally with a KoboldAI UI. One File. Zero Install.☆12,123Updated this week
- Prebuilt Windows ROCm Libs for gfx1031 and gfx1032☆189Mar 19, 2025Updated last year
- The most powerful and modular stable diffusion GUI, api and backend with a graph/nodes interface. Now ZLUDA enhanced for better AMD GPU p…☆995Updated this week
- CUDA on AMD GPUs☆613Feb 11, 2026Updated 8 months ago
- ROCm Library Files for gfx1103 and update with others arches based on AMD GPUs for use in Windows.☆899May 18, 2026Updated 5 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Forge for stable-diffusion-webui-amdgpu (formerly stable-diffusion-webui-directml)☆185Jun 1, 2026Updated 5 months ago
- Stable Diffusion web UI☆2,406Mar 5, 2026Updated 7 months ago
- Get up and running with Llama 3, Mistral, Gemma, and other large language models.by adding more amd gpu support.☆1,792Aug 30, 2026Updated 2 months ago
- Croco.Cpp is fork of KoboldCPP infering GGML/GGUF models on CPU/Cuda with KoboldAI's UI. It's powered partly by IK_LLama.cpp, and compati…☆185Sep 18, 2026Updated last month
- AMD-SHARK Studio -- Web UI for SHARK+IREE High Performance Machine Learning Distribution☆1,450Dec 15, 2025Updated 10 months ago
- AITemplate is a Python framework which renders neural network into high performance CUDA/HIP C++ code. Specialized for FP16 TensorCore (N…☆12Jun 24, 2024Updated 2 years ago
- CUDA on non-NVIDIA GPUs☆15,159Updated this week
- Installation script for an AI applications using ROCm on Linux.☆52Oct 9, 2026Updated 3 weeks ago
- Fresh builds of llama.cpp with AMD ROCm™ acceleration☆799Updated this week
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Stable Diffusion Knowledge Base (Setups, Basics, Guides and more)☆131Jan 30, 2026Updated 9 months ago
- The HIP Environment and ROCm Kit - A lightweight open source build system for HIP and ROCm☆1,421Updated this week
- Stable Diffusion GUI written in C++☆98Jun 25, 2026Updated 4 months ago
- SD.Next: All-in-one WebUI for AI generative image and video creation, captioning and processing☆7,365Updated this week
- OneTrainer is a one-stop solution for all your stable diffusion training needs.☆19Oct 6, 2025Updated last year
- Fast and memory-efficient exact attention☆242Aug 12, 2026Updated 2 months ago
- Loader extension for tabbyAPI in SillyTavern☆27Jun 30, 2025Updated last year
- Simple monkeypatch to boost AMD Navi 3 GPUs☆51Apr 21, 2025Updated last year
- My own ROCm windows builds from TheRock repository for various architectures such as 680m, 780m, rx6600, etc.☆94Dec 8, 2025Updated 10 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Diffusion model(SD,Flux,Wan,Qwen Image,Z-Image,...) inference in pure C/C++☆7,853Updated this week
- FusionQuant Model Merge & GGUF Conversion Pipeline - Your Free Toolkit for Custom LLMs!☆14Jun 24, 2025Updated last year
- Guides to hopefully simplify the process of using ROCm.☆12Sep 26, 2024Updated 2 years ago
- Open-source desktop app for local LLMs. Text, vision, tool-calling, OpenAI/Anthropic-compatible API. 100% private.☆47,727Aug 17, 2026Updated 2 months ago
- add support on amd in zluda☆78Jul 21, 2025Updated last year
- This project simplifies the installation process of likelovewant's library, making it easier for users to manage and update their AMD GPU…☆384Oct 1, 2026Updated last month
- llama.cpp fork with additional SOTA quants and improved performance☆3,364Updated this week
- LLM Frontend for Power Users.☆35,225Oct 2, 2026Updated last month
- The HIP Environment and ROCm Kit - A lightweight open source build system for HIP and ROCm☆123Jun 10, 2026Updated 4 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A high-throughput and memory-efficient inference and serving engine for LLMs - Optimized for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI…☆94Oct 8, 2026Updated 3 weeks ago
- LLM Frontend in a single html file☆757Dec 27, 2025Updated 10 months ago
- ☆12May 22, 2024Updated 2 years ago
- KoboldAI is generative AI software optimized for fictional use, but capable of much more!☆440Oct 14, 2026Updated 2 weeks ago
- Large-scale LLM inference engine☆1,899Updated this week
- A zero dependency web UI for any LLM backend, including KoboldCpp, OpenAI and AI Horde☆205Updated this week
- 8-bit CUDA functions for PyTorch, ported to HIP for use in AMD GPUs☆56Apr 9, 2023Updated 3 years ago