YellowRoseCx / koboldcpp-rocmLinks
AI Inferencing at the Edge. A simple one-file way to run various GGML models with KoboldAI's UI with AMD ROCm offloading
☆737Updated last month
Alternatives and similar repositories for koboldcpp-rocm
Users that are interested in koboldcpp-rocm are comparing it to the libraries listed below
Sorting:
- The most powerful and modular stable diffusion GUI, api and backend with a graph/nodes interface. Now ZLUDA enhanced for better AMD GPU p…☆785Updated this week
- Prebuilt Windows ROCm Libs for gfx1031 and gfx1032☆169Updated 10 months ago
- AMD (Radeon GPU) ROCm based setup for popular AI tools on Ubuntu 24.04.1☆217Updated this week
- CUDA on AMD GPUs☆596Updated last week
- The official API server for Exllama. OAI compatible, lightweight, and fast.☆1,121Updated 2 weeks ago
- Forge for stable-diffusion-webui-amdgpu (formerly stable-diffusion-webui-directml)☆166Updated 4 months ago
- add support on amd in zluda☆78Updated 6 months ago
- ROCm Library Files for gfx1103 and update with others arches based on AMD GPUs for use in Windows.☆742Updated 4 months ago
- The HIP Environment and ROCm Kit - A lightweight open source build system for HIP and ROCm☆122Updated 3 weeks ago
- Croco.Cpp is fork of KoboldCPP infering GGML/GGUF models on CPU/Cuda with KoboldAI's UI. It's powered partly by IK_LLama.cpp, and compati…☆154Updated last week
- ☆428Updated 10 months ago
- Web UI for ExLlamaV2☆513Updated last year
- An extension for SillyTavern that lets characters think before responding☆141Updated 3 weeks ago
- LLM Frontend in a single html file☆692Updated last month
- Stable Diffusion web UI☆2,320Updated last month
- An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs☆626Updated last week
- llama.cpp fork with additional SOTA quants and improved performance☆1,587Updated this week
- Run GGUF models easily with a KoboldAI UI. One File. Zero Install.☆9,408Updated this week
- A zero dependency web UI for any LLM backend, including KoboldCpp, OpenAI and AI Horde☆160Updated this week
- KoboldAI is generative AI software optimized for fictional use, but capable of much more!☆422Updated last year
- Stable Diffusion Docker image preconfigured for usage with AMD Radeon cards☆145Updated last year
- ☆674Updated 3 weeks ago
- Stable Diffusion Knowledge Base (Setups, Basics, Guides and more)☆118Updated last week
- Inference engine for Intel devices. Serve LLMs, VLMs, Whisper, Kokoro-TTS, Embedding and Rerank models over OpenAI endpoints.☆290Updated last week
- Next-generation AI roleplay system☆300Updated last week
- Extensions API for SillyTavern.☆670Updated last year
- A daemon that automatically manages the performance states of NVIDIA GPUs.☆110Updated 3 months ago
- OneTrainer is a one-stop solution for all your stable diffusion training needs.☆17Updated 4 months ago
- Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc☆2,311Updated this week
- ☆164Updated this week