AI Inferencing at the Edge. A simple one-file way to run various GGML models with KoboldAI's UI with AMD ROCm offloading
☆767Dec 30, 2025Updated 4 months ago
Alternatives and similar repositories for koboldcpp-rocm
Users that are interested in koboldcpp-rocm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Run GGUF models easily with a KoboldAI UI. One File. Zero Install.☆10,323Apr 26, 2026Updated last week
- The most powerful and modular stable diffusion GUI, api and backend with a graph/nodes interface. Now ZLUDA enhanced for better AMD GPU p…☆876Updated this week
- Prebuilt Windows ROCm Libs for gfx1031 and gfx1032☆175Mar 19, 2025Updated last year
- CUDA on AMD GPUs☆607Feb 11, 2026Updated 2 months ago
- Forge for stable-diffusion-webui-amdgpu (formerly stable-diffusion-webui-directml)☆172Sep 29, 2025Updated 7 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Stable Diffusion web UI☆2,355Mar 5, 2026Updated last month
- Installation script for an AI applications using ROCm on Linux.☆45Updated this week
- ☆433Apr 4, 2025Updated last year
- AMD-SHARK Studio -- Web UI for SHARK+IREE High Performance Machine Learning Distribution☆1,456Dec 15, 2025Updated 4 months ago
- AITemplate is a Python framework which renders neural network into high performance CUDA/HIP C++ code. Specialized for FP16 TensorCore (N…☆12Jun 24, 2024Updated last year
- OneTrainer is a one-stop solution for all your stable diffusion training needs.☆16Oct 6, 2025Updated 6 months ago
- Stable Diffusion Knowledge Base (Setups, Basics, Guides and more)☆123Jan 30, 2026Updated 3 months ago
- CUDA on non-NVIDIA GPUs☆14,162Updated this week
- add support on amd in zluda☆75Jul 21, 2025Updated 9 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Get up and running with Llama 3, Mistral, Gemma, and other large language models.by adding more amd gpu support.☆1,734Apr 16, 2026Updated 2 weeks ago
- Fast and memory-efficient exact attention☆230Updated this week
- Guides to hopefully simplify the process of using ROCm.☆12Sep 26, 2024Updated last year
- My own ROCm windows builds from TheRock repository for various architectures such as 680m, 780m, rx6600, etc.☆74Dec 8, 2025Updated 4 months ago
- Everything you need to setup on your AMD system for Machine Learning Stuff☆19Jul 31, 2025Updated 9 months ago
- An extension for SillyTavern that lets characters think before responding☆151Jan 9, 2026Updated 3 months ago
- A multi-voice TTS system trained with an emphasis on quality☆18Jun 10, 2024Updated last year
- WanImageToVideo ComfyUI node, with Tiled VAE☆15Oct 22, 2025Updated 6 months ago
- LLM Frontend for Power Users.☆26,387Updated this week
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Loader extension for tabbyAPI in SillyTavern☆26Jun 30, 2025Updated 10 months ago
- Stable Diffusion GUI written in C++☆93Oct 3, 2025Updated 7 months ago
- ☆24Mar 23, 2026Updated last month
- Simple monkeypatch to boost AMD Navi 3 GPUs☆49Apr 21, 2025Updated last year
- Croco.Cpp is fork of KoboldCPP infering GGML/GGUF models on CPU/Cuda with KoboldAI's UI. It's powered partly by IK_LLama.cpp, and compati…☆169Apr 23, 2026Updated last week
- A fast inference library for running LLMs locally on modern consumer-class GPUs☆4,511Mar 4, 2026Updated last month
- Make PyTorch models at least run on APUs.☆56Dec 16, 2023Updated 2 years ago
- The HIP Environment and ROCm Kit - A lightweight open source build system for HIP and ROCm☆122Mar 19, 2026Updated last month
- A free AI text generation interface based on KoboldAI☆33Feb 27, 2024Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- The original local LLM interface. Text, vision, tool-calling, training. UI + API, 100% offline and private.☆46,874Updated this week
- 111 VRM Animation Pack: For use with Silly Tavern☆72Apr 11, 2026Updated 3 weeks ago
- Example code and documentation on how to get Stable Diffusion running with ONNX FP16 models on DirectML. Can run accelerated on all Direc…☆302Oct 15, 2023Updated 2 years ago
- The official API server for Exllama. OAI compatible, lightweight, and fast.☆1,197Apr 24, 2026Updated last week
- Diffusion model(SD,Flux,Wan,Qwen Image,Z-Image,...) inference in pure C/C++☆5,894Updated this week
- KoboldAI is generative AI software optimized for fictional use, but capable of much more!☆429Jan 16, 2025Updated last year
- The HIP Environment and ROCm Kit - A lightweight open source build system for HIP and ROCm☆979Updated this week