YellowRoseCx / koboldcpp-rocm
AI Inferencing at the Edge. A simple one-file way to run various GGML models with KoboldAI's UI with AMD ROCm offloading
☆600Updated 3 weeks ago
Alternatives and similar repositories for koboldcpp-rocm:
Users that are interested in koboldcpp-rocm are comparing it to the libraries listed below
- CUDA on AMD GPUs☆472Updated this week
- Prebuilt Windows ROCm Libs for gfx1031 and gfx1032☆131Updated last month
- An OAI compatible exllamav2 API that's both lightweight and fast☆925Updated this week
- AMD (Radeon GPU) ROCm based setup for popular AI tools on Ubuntu 24.04.1☆204Updated 2 months ago
- The most powerful and modular stable diffusion GUI, api and backend with a graph/nodes interface. Now ZLUDA enhanced for better AMD GPU p…☆389Updated this week
- Forge for stable-diffusion-webui-amdgpu (formerly stable-diffusion-webui-directml)☆117Updated 2 weeks ago
- Croco.Cpp is a 3rd party testground for KoboldCPP, a simple one-file way to run various GGML/GGUF models with KoboldAI's UI. (for Croco.C…☆104Updated this week
- Web UI for ExLlamaV2☆492Updated 3 months ago
- Run GGUF models easily with a KoboldAI UI. One File. Zero Install.☆7,188Updated this week
- An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs☆335Updated this week
- ☆307Updated last month
- Extensions API for SillyTavern.☆612Updated 4 months ago
- KoboldAI is generative AI software optimized for fictional use, but capable of much more!☆405Updated 3 months ago
- LLM Frontend in a single html file☆457Updated 3 months ago
- A zero dependency web UI for any LLM backend, including KoboldCpp, OpenAI and AI Horde☆115Updated this week
- add support on amd in zluda☆56Updated last month
- An extension for SillyTavern that lets characters think before responding☆106Updated 2 months ago
- Simple monkeypatch to boost AMD Navi 3 GPUs☆39Updated 2 weeks ago
- ☆156Updated last year
- Stable Diffusion Knowledge Base (Setups, Basics, Guides and more)☆72Updated last month
- Stable Diffusion web UI☆2,080Updated last week
- Docker variants of oobabooga's text-generation-webui, including pre-built images.☆421Updated this week
- SHARK Studio -- Web UI for SHARK+IREE High Performance Machine Learning Distribution☆1,444Updated last month
- Large-scale LLM inference engine☆1,405Updated this week
- A modern, minimalist, and elegant theme for SillyTavern. Inspired by moonlit nights and gentle echoes of serenity.☆62Updated this week
- Model swapping for llama.cpp (or any local OpenAPI compatible server)☆662Updated this week
- Lightweight Inference server for OpenVINO☆163Updated last week
- AI PC starter app for doing AI image creation, image stylizing, and chatbot on a PC powered by an Intel® Arc™ GPU.☆532Updated this week
- ☆697Updated this week
- Dolphin System Messages☆302Updated 2 months ago