YellowRoseCx / koboldcpp-rocm
AI Inferencing at the Edge. A simple one-file way to run various GGML models with KoboldAI's UI with AMD ROCm offloading
☆450Updated this week
Related projects ⓘ
Alternatives and complementary repositories for koboldcpp-rocm
- CUDA on AMD GPUs☆297Updated 2 months ago
- An OAI compatible exllamav2 API that's both lightweight and fast☆605Updated this week
- AMD (Radeon GPU) ROCm based setup for popular AI tools on Ubuntu 24.04.1☆173Updated 3 weeks ago
- The most powerful and modular stable diffusion GUI, api and backend with a graph/nodes interface. Now ZLUDA enhanced for better AMD GPU p…☆153Updated this week
- Forge for stable-diffusion-webui-amdgpu (formerly stable-diffusion-webui-directml)☆61Updated last week
- Extensions API for SillyTavern.☆565Updated 2 months ago
- ☆563Updated last month
- ☆115Updated last year
- Prebuilt Windows ROCm Libs for gfx1031 and gfx1032☆75Updated 2 months ago
- Web UI for ExLlamaV2☆445Updated last month
- KoboldAI is generative AI software optimized for fictional use, but capable of much more!☆371Updated 4 months ago
- ☆150Updated last year
- ROCm Library Files for gfx1103 and update with others arches based on AMD GPUs for use in Windows.☆141Updated this week
- Launcher scripts for SillyTavern and ST-Extras.☆213Updated last week
- Croco.Cpp is a 3rd party testground for KoboldCPP, a simple one-file way to run various GGML/GGUF models with KoboldAI's UI. (for Croco.C…☆82Updated this week
- SHARK Studio -- Web UI for SHARK+IREE High Performance Machine Learning Distribution☆1,423Updated last month
- A zero dependency web UI for any LLM backend, including KoboldCpp, OpenAI and AI Horde☆81Updated this week
- LLM Frontend in a single html file☆259Updated 2 weeks ago
- Run GGUF models easily with a KoboldAI UI. One File. Zero Install.☆5,290Updated this week
- Get up and running with Llama 3, Mistral, Gemma, and other large language models.by adding more amd gpu support.☆186Updated this week
- DEPRECATED!☆53Updated 5 months ago
- Simple monkeypatch to boost AMD Navi 3 GPUs☆19Updated 6 months ago
- Example code and documentation on how to get Stable Diffusion running with ONNX FP16 models on DirectML. Can run accelerated on all Direc…☆293Updated last year
- ☆201Updated last year
- A simple FastAPI Server to run XTTSv2☆411Updated 3 months ago
- A gradio web UI for running Large Language Models like GPT-J 6B, OPT, GALACTICA, LLaMA, and Pygmalion.☆307Updated last year
- My personal fork of koboldcpp where I hack in experimental samplers.☆42Updated 6 months ago
- An AI assistant beyond the chat box.☆315Updated 8 months ago
- 8-bit CUDA functions for PyTorch Rocm compatible☆39Updated 7 months ago
- Stable Diffusion Docker image preconfigured for usage with AMD Radeon cards☆126Updated 6 months ago