Alternatives and similar repositories for koboldcpp-rocm

Users that are interested in koboldcpp-rocm are comparing it to the libraries listed below

• patientx / ComfyUI-Zluda
  The most powerful and modular stable diffusion GUI, api and backend with a graph/nodes interface. Now ZLUDA enhanced for better AMD GPU p…
  ☆785Updated this week
• brknsoul / ROCmLibs
  Prebuilt Windows ROCm Libs for gfx1031 and gfx1032
  ☆169Updated 10 months ago
• lshqqytiger / stable-diffusion-webui-amdgpu-forge
  Forge for stable-diffusion-webui-amdgpu (formerly stable-diffusion-webui-directml)
  ☆166Updated 4 months ago
• lshqqytiger / ZLUDA
  CUDA on AMD GPUs
  ☆596Updated last week
• theroyallab / tabbyAPI
  The official API server for Exllama. OAI compatible, lightweight, and fast.
  ☆1,121Updated 2 weeks ago
• nktice / AMD-AI
  AMD (Radeon GPU) ROCm based setup for popular AI tools on Ubuntu 24.04.1
  ☆217Updated this week
• likelovewant / stable-diffusion-webui-forge-on-amd
  add support on amd in zluda
  ☆78Updated 6 months ago
• nod-ai / AMD-SHARK-Studio
  AMD-SHARK Studio -- Web UI for SHARK+IREE High Performance Machine Learning Distribution
  ☆1,453Updated last month
• lamikr / rocm_sdk_builder
  ☆428Updated 10 months ago
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆1,587Updated this week
• turboderp-org / exui
  Web UI for ExLlamaV2
  ☆513Updated last year
• scottt / rocm-TheRock
  The HIP Environment and ROCm Kit - A lightweight open source build system for HIP and ROCm
  ☆122Updated 3 weeks ago
• lshqqytiger / stable-diffusion-webui-amdgpu
  Stable Diffusion web UI
  ☆2,320Updated last month
• xuhuisheng / rocm-gfx803
  ☆238Updated 2 years ago
• CS1o / Stable-Diffusion-Info
  Stable Diffusion Knowledge Base (Setups, Basics, Guides and more)
  ☆118Updated last week
• SillyTavern / SillyTavern-Extras
  Extensions API for SillyTavern.
  ☆670Updated last year
• mostlygeek / llama-swap
  Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc
  ☆2,311Updated this week
• turboderp-org / exllamav3
  An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs
  ☆626Updated last week
• Nexesenex / croco.cpp
  Croco.Cpp is fork of KoboldCPP infering GGML/GGUF models on CPU/Cuda with KoboldAI's UI. It's powered partly by IK_LLama.cpp, and compati…
  ☆156Updated this week
• LostRuins / koboldcpp
  Run GGUF models easily with a KoboldAI UI. One File. Zero Install.
  ☆9,408Updated this week
• LostRuins / lite.koboldai.net
  A zero dependency web UI for any LLM backend, including KoboldCpp, OpenAI and AI Horde
  ☆160Updated this week
• l1na-forever / stable-diffusion-rocm-docker
  Stable Diffusion Docker image preconfigured for usage with AMD Radeon cards
  ☆145Updated last year
• lmg-anon / mikupad
  LLM Frontend in a single html file
  ☆694Updated last month
• henk717 / KoboldAI
  KoboldAI is generative AI software optimized for fictional use, but capable of much more!
  ☆422Updated last year
• cierru / st-stepped-thinking
  An extension for SillyTavern that lets characters think before responding
  ☆141Updated 3 weeks ago
• FastFlowLM / FastFlowLM
  Run LLMs on AMD Ryzen™ AI NPUs in minutes. Just like Ollama - but purpose-built and deeply optimized for the AMD NPUs.
  ☆689Updated last week
• Samueras / GuidedGenerations-Extension
  ☆164Updated this week
• p-e-w / waidrin
  Next-generation AI roleplay system
  ☆300Updated last week
• RivelleDays / SillyTavern-MoonlitEchoesTheme
  A modern, minimalist, and elegant theme for SillyTavern. Inspired by moonlit nights and gentle echoes of serenity.
  ☆267Updated last week
• Samueras / Guided-Generations
  A Quick Reply Set for Sillytavern to gently guide the Model output
  ☆81Updated 10 months ago