Alternatives and similar repositories for koboldcpp

Users that are interested in koboldcpp are comparing it to the libraries listed below

• KoboldAI / KoboldAI-Client
  For GGUF support, see KoboldCPP: https://github.com/LostRuins/koboldcpp
  ☆3,856Updated last year
• TavernAI / TavernAI
  Atmospheric adventure chat for AI language models (KoboldAI, NovelAI, Pygmalion, OpenAI chatgpt, gpt-4)
  ☆2,635Updated last month
• YellowRoseCx / koboldcpp-rocm
  AI Inferencing at the Edge. A simple one-file way to run various GGML models with KoboldAI's UI with AMD ROCm offloading
  ☆737Updated last month
• oobabooga / text-generation-webui
  The definitive Web UI for local AI, with powerful features and easy setup.
  ☆46,006Updated this week
• theroyallab / tabbyAPI
  The official API server for Exllama. OAI compatible, lightweight, and fast.
  ☆1,121Updated 2 weeks ago
• turboderp-org / exllamav2
  A fast inference library for running LLMs locally on modern consumer-class GPUs
  ☆4,431Updated last month
• leejet / stable-diffusion.cpp
  Diffusion model(SD,Flux,Wan,Qwen Image,Z-Image,...) inference in pure C/C++
  ☆5,327Updated this week
• SillyTavern / SillyTavern
  LLM Frontend for Power Users.
  ☆22,802Updated this week
• ParisNeo / lollms-webui
  Lord of Large Language and Multi modal Systems Web User Interface
  ☆4,772Updated 2 weeks ago
• SillyTavern / SillyTavern-Extras
  Extensions API for SillyTavern.
  ☆670Updated last year
• erew123 / alltalk_tts
  AllTalk is based on the Coqui TTS engine, similar to the Coqui_tts extension for Text generation webUI, however supports a variety of adv…
  ☆2,240Updated 3 weeks ago
• turboderp / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆2,908Updated 2 years ago
• vladmandic / sdnext
  SD.Next: All-in-one WebUI for AI generative image and video creation, captioning and processing
  ☆6,915Updated last week
• mcmonkeyprojects / SwarmUI
  SwarmUI (formerly StableSwarmUI), A Modular Stable Diffusion Web-User-Interface, with an emphasis on making powertools easily accessible,…
  ☆3,645Updated last week
• lllyasviel / stable-diffusion-webui-forge
  ☆12,141Updated 6 months ago
• pinokiocomputer / pinokio
  AI Browser
  ☆6,669Updated last week
• rsxdalv / TTS-WebUI
  A single Gradio + React WebUI with extensions for ACE-Step, Kimi Audio, Piper TTS, GPT-SoVITS, CosyVoice, XTTSv2, DIA, Kokoro, OpenVoice,…
  ☆2,939Updated last week
• Haidra-Org / AI-Horde
  A crowdsourced distributed cluster for AI art and text generation
  ☆1,311Updated last week
• oobabooga / text-generation-webui-extensions
  ☆674Updated 3 weeks ago
• henk717 / KoboldAI
  KoboldAI is generative AI software optimized for fictional use, but capable of much more!
  ☆422Updated last year
• LykosAI / StabilityMatrix
  Multi-Platform Package Manager for Stable Diffusion
  ☆7,392Updated last week
• lmg-anon / mikupad
  LLM Frontend in a single html file
  ☆692Updated last month
• ex3ndr / llama-coder
  Replace Copilot local AI
  ☆2,084Updated last year
• abetlen / llama-cpp-python
  Python bindings for llama.cpp
  ☆9,958Updated 5 months ago
• rupeshs / fastsdcpu
  Fast stable diffusion on CPU and AI PC
  ☆1,980Updated 3 weeks ago
• mostlygeek / llama-swap
  Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc
  ☆2,311Updated this week
• antimatter15 / alpaca.cpp
  Locally run an Instruction-Tuned Chat-Style LLM
  ☆10,187Updated 2 years ago
• Sumandora / remove-refusals-with-transformers
  Implements harmful/harmless refusal removal using pure HF Transformers
  ☆1,459Updated 2 months ago
• aphrodite-engine / aphrodite-engine
  Large-scale LLM inference engine
  ☆1,641Updated 2 weeks ago
• ggml-org / ggml
  Tensor library for machine learning
  ☆13,907Updated last week