YellowRoseCx / koboldcpp-rocmLinks
AI Inferencing at the Edge. A simple one-file way to run various GGML models with KoboldAI's UI with AMD ROCm offloading
☆638Updated last week
Alternatives and similar repositories for koboldcpp-rocm
Users that are interested in koboldcpp-rocm are comparing it to the libraries listed below
Sorting:
- CUDA on AMD GPUs☆517Updated last month
- The most powerful and modular stable diffusion GUI, api and backend with a graph/nodes interface. Now ZLUDA enhanced for better AMD GPU p…☆456Updated this week
- The official API server for Exllama. OAI compatible, lightweight, and fast.☆987Updated last week
- Prebuilt Windows ROCm Libs for gfx1031 and gfx1032☆142Updated 3 months ago
- AMD (Radeon GPU) ROCm based setup for popular AI tools on Ubuntu 24.04.1☆205Updated 4 months ago
- Forge for stable-diffusion-webui-amdgpu (formerly stable-diffusion-webui-directml)☆130Updated this week
- Croco.Cpp is fork of KoboldCPP infering GGML/GGUF models on CPU/Cuda with KoboldAI's UI. It's powered partly by IK_LLama.cpp, and compati…☆107Updated this week
- Web UI for ExLlamaV2☆502Updated 4 months ago
- LLM Frontend in a single html file☆498Updated 5 months ago
- add support on amd in zluda☆64Updated last month
- An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs☆408Updated last week
- Stable Diffusion Knowledge Base (Setups, Basics, Guides and more)☆82Updated 2 months ago
- Run GGUF models easily with a KoboldAI UI. One File. Zero Install.☆7,595Updated this week
- Extensions API for SillyTavern.☆629Updated 6 months ago
- A zero dependency web UI for any LLM backend, including KoboldCpp, OpenAI and AI Horde☆126Updated this week
- Stable Diffusion web UI☆2,124Updated last month
- SHARK Studio -- Web UI for SHARK+IREE High Performance Machine Learning Distribution☆1,446Updated 2 months ago
- Simple monkeypatch to boost AMD Navi 3 GPUs☆42Updated 2 months ago
- ☆638Updated last week
- An extension for SillyTavern that lets characters think before responding☆111Updated 4 months ago
- Docker variants of oobabooga's text-generation-webui, including pre-built images.☆430Updated 2 weeks ago
- Dolphin System Messages☆318Updated 4 months ago
- Stable Diffusion Docker image preconfigured for usage with AMD Radeon cards☆136Updated last year
- KoboldAI is generative AI software optimized for fictional use, but capable of much more!☆410Updated 5 months ago
- Memoir+ a persona memory extension for Text Gen Web UI.☆205Updated 2 weeks ago
- Launcher scripts for SillyTavern and ST-Extras.☆363Updated last week
- ☆337Updated 2 months ago
- Run stable-diffusion-webui with Radeon RX 580 8GB on Ubuntu 22.04.2 LTS☆64Updated last year
- A daemon that automatically manages the performance states of NVIDIA GPUs.☆89Updated 2 weeks ago
- UI for ONNX based diffusers☆191Updated 2 years ago