YellowRoseCx / koboldcpp-rocm
AI Inferencing at the Edge. A simple one-file way to run various GGML models with KoboldAI's UI with AMD ROCm offloading
☆396Updated 2 weeks ago
Related projects: ⓘ
- Web UI for ExLlamaV2☆420Updated 2 weeks ago
- ☆112Updated last year
- Extensions API for SillyTavern.☆543Updated 3 weeks ago
- AMD (Radeon GPU) ROCm based setup for popular AI tools on Ubuntu 24.04.1☆159Updated this week
- ☆543Updated 2 weeks ago
- An OAI compatible exllamav2 API that's both lightweight and fast☆455Updated this week
- CUDA on AMD GPUs☆258Updated this week
- The most powerful and modular stable diffusion GUI, api and backend with a graph/nodes interface. Now ZLUDA enhanced for better AMD GPU p…☆116Updated this week
- Croco.Cpp is a 3rd party testground for KoboldCPP, a simple one-file way to run various GGML/GGUF models with KoboldAI's UI. (for Crocori…☆80Updated this week
- KoboldAI is generative AI software optimized for fictional use, but capable of much more!☆359Updated 2 months ago
- ☆151Updated 11 months ago
- Prebuilt Windows ROCm Libs for gfx1031 and gfx1032☆63Updated last week
- AllTalk is based on the Coqui TTS engine, similar to the Coqui_tts extension for Text generation webUI, however supports a variety of adv…☆871Updated this week
- Simple frontend for LLMs built in react-native.☆314Updated this week
- LLM Frontend in a single html file☆221Updated last week
- A gradio web UI for running Large Language Models like GPT-J 6B, OPT, GALACTICA, LLaMA, and Pygmalion.☆305Updated last year
- Run GGUF models easily with a KoboldAI UI. One File. Zero Install.☆4,836Updated this week
- Webui for using XTTS and for finetuning it☆532Updated 3 months ago
- Launcher scripts for SillyTavern and ST-Extras.☆173Updated last week
- Forge for stable-diffusion-webui-amdgpu (formerly stable-diffusion-webui-directml)☆38Updated last week
- Stable Diffusion Docker image preconfigured for usage with AMD Radeon cards☆123Updated 4 months ago
- SHARK - High Performance Machine Learning Distribution☆1,413Updated last month
- A zero dependency web UI for KoboldAI Horde☆69Updated this week
- An AI assistant beyond the chat box.☆314Updated 6 months ago
- Large-scale LLM inference engine☆934Updated this week
- AI Agnostic (Multi-user and Multi-bot) Chat with Fictional Characters. Designed with scale in mind.☆510Updated this week
- Simple monkeypatch to boost AMD Navi 3 GPUs☆14Updated 4 months ago
- A simple FastAPI Server to run XTTSv2☆357Updated last month
- 8-bit CUDA functions for PyTorch Rocm compatible☆37Updated 5 months ago
- An OpenAI API compatible text to speech server using Coqui AI's xtts_v2 and/or piper tts as the backend.☆315Updated 3 weeks ago