YellowRoseCx / koboldcpp-rocm
AI Inferencing at the Edge. A simple one-file way to run various GGML models with KoboldAI's UI with AMD ROCm offloading
☆506Updated this week
Alternatives and similar repositories for koboldcpp-rocm:
Users that are interested in koboldcpp-rocm are comparing it to the libraries listed below
- An OAI compatible exllamav2 API that's both lightweight and fast☆750Updated 2 weeks ago
- The most powerful and modular stable diffusion GUI, api and backend with a graph/nodes interface. Now ZLUDA enhanced for better AMD GPU p…☆239Updated this week
- Prebuilt Windows ROCm Libs for gfx1031 and gfx1032☆94Updated last week
- Forge for stable-diffusion-webui-amdgpu (formerly stable-diffusion-webui-directml)☆82Updated last week
- CUDA on AMD GPUs☆353Updated 2 weeks ago
- Croco.Cpp is a 3rd party testground for KoboldCPP, a simple one-file way to run various GGML/GGUF models with KoboldAI's UI. (for Croco.C…☆92Updated this week
- LLM Frontend in a single html file☆313Updated 2 weeks ago
- Web UI for ExLlamaV2☆468Updated this week
- ☆585Updated this week
- ROCm Library Files for gfx1103 and update with others arches based on AMD GPUs for use in Windows.☆225Updated 3 weeks ago
- add support on amd in zluda☆39Updated last week
- Extensions API for SillyTavern.☆582Updated last month
- AMD (Radeon GPU) ROCm based setup for popular AI tools on Ubuntu 24.04.1☆187Updated this week
- A zero dependency web UI for any LLM backend, including KoboldCpp, OpenAI and AI Horde☆97Updated this week
- Stable Diffusion Docker image preconfigured for usage with AMD Radeon cards☆129Updated 8 months ago
- Run GGUF models easily with a KoboldAI UI. One File. Zero Install.☆6,194Updated this week
- ☆152Updated last year
- KoboldAI is generative AI software optimized for fictional use, but capable of much more!☆383Updated last week
- An extension for SillyTavern that lets characters think before responding☆70Updated this week
- Simple monkeypatch to boost AMD Navi 3 GPUs☆32Updated 8 months ago
- ☆172Updated this week
- ☆211Updated last year
- An OpenAI API compatible text to speech server using Coqui AI's xtts_v2 and/or piper tts as the backend.☆640Updated 5 months ago
- Launcher scripts for SillyTavern and ST-Extras.☆251Updated last week
- A simple character editor for v2 Tavern Character Cards☆49Updated last week
- A simple FastAPI Server to run XTTSv2☆461Updated 6 months ago
- A launcher that let's you install, uninstall, update, backup and uninstall SillyTavern and SillyTavernExtras☆80Updated 9 months ago
- Memoir+ a persona extension for Text Gen Web UI. That includes memory, emotions, command handling and more.☆182Updated last week
- An extension for oobabooga/text-generation-webui that enables the LLM to search the web using DuckDuckGo☆201Updated this week
- My personal fork of koboldcpp where I hack in experimental samplers.☆43Updated 8 months ago