YellowRoseCx / koboldcpp-rocmLinks
AI Inferencing at the Edge. A simple one-file way to run various GGML models with KoboldAI's UI with AMD ROCm offloading
☆682Updated 2 weeks ago
Alternatives and similar repositories for koboldcpp-rocm
Users that are interested in koboldcpp-rocm are comparing it to the libraries listed below
Sorting:
- The most powerful and modular stable diffusion GUI, api and backend with a graph/nodes interface. Now ZLUDA enhanced for better AMD GPU p…☆571Updated this week
- CUDA on AMD GPUs☆549Updated 3 months ago
- Prebuilt Windows ROCm Libs for gfx1031 and gfx1032☆159Updated 5 months ago
- The official API server for Exllama. OAI compatible, lightweight, and fast.☆1,039Updated last week
- Forge for stable-diffusion-webui-amdgpu (formerly stable-diffusion-webui-directml)☆140Updated last week
- AMD (Radeon GPU) ROCm based setup for popular AI tools on Ubuntu 24.04.1☆209Updated 6 months ago
- add support on amd in zluda☆71Updated last month
- ROCm Library Files for gfx1103 and update with others arches based on AMD GPUs for use in Windows.☆581Updated 7 months ago
- Web UI for ExLlamaV2☆508Updated 6 months ago
- Croco.Cpp is fork of KoboldCPP infering GGML/GGUF models on CPU/Cuda with KoboldAI's UI. It's powered partly by IK_LLama.cpp, and compati…☆135Updated this week
- An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs☆484Updated this week
- LLM Frontend in a single html file☆635Updated 7 months ago
- ☆381Updated 4 months ago
- Extensions API for SillyTavern.☆640Updated 8 months ago
- SHARK Studio -- Web UI for SHARK+IREE High Performance Machine Learning Distribution☆1,448Updated 5 months ago
- A zero dependency web UI for any LLM backend, including KoboldCpp, OpenAI and AI Horde☆133Updated this week
- Next-generation AI roleplay system☆218Updated last month
- KoboldAI is generative AI software optimized for fictional use, but capable of much more!☆415Updated 7 months ago
- An extension for SillyTavern that lets characters think before responding☆117Updated 6 months ago
- A modern, minimalist, and elegant theme for SillyTavern. Inspired by moonlit nights and gentle echoes of serenity.☆162Updated last week
- AI PC starter app for doing AI image creation, image stylizing, and chatbot on a PC powered by an Intel® Arc™ GPU.☆593Updated last week
- llama.cpp fork with additional SOTA quants and improved performance☆1,096Updated last week
- ☆655Updated last week
- Launcher scripts for SillyTavern and ST-Extras.☆380Updated this week
- Simple monkeypatch to boost AMD Navi 3 GPUs☆44Updated 4 months ago
- Stable Diffusion Docker image preconfigured for usage with AMD Radeon cards☆138Updated last year
- ☆231Updated 2 years ago
- Stable Diffusion Knowledge Base (Setups, Basics, Guides and more)☆97Updated last month
- A Quick Reply Set for Sillytavern to gently guide the Model output☆75Updated 5 months ago
- Stable Diffusion web UI☆2,206Updated this week