Alternatives and similar repositories for koboldcpp

Users that are interested in koboldcpp are comparing it to the libraries listed below

• KoboldAI / KoboldAI-Client
  For GGUF support, see KoboldCPP: https://github.com/LostRuins/koboldcpp
  ☆3,827Updated 10 months ago
• SillyTavern / SillyTavern
  LLM Frontend for Power Users.
  ☆20,611Updated this week
• TavernAI / TavernAI
  Atmospheric adventure chat for AI language models (KoboldAI, NovelAI, Pygmalion, OpenAI chatgpt, gpt-4)
  ☆2,585Updated last month
• YellowRoseCx / koboldcpp-rocm
  AI Inferencing at the Edge. A simple one-file way to run various GGML models with KoboldAI's UI with AMD ROCm offloading
  ☆718Updated 2 weeks ago
• oobabooga / text-generation-webui
  The definitive Web UI for local AI, with powerful features and easy setup.
  ☆45,550Updated this week
• vladmandic / sdnext
  SD.Next: All-in-one WebUI for AI generative image and video creation
  ☆6,813Updated this week
• turboderp-org / exllamav2
  A fast inference library for running LLMs locally on modern consumer-class GPUs
  ☆4,379Updated 3 months ago
• theroyallab / tabbyAPI
  The official API server for Exllama. OAI compatible, lightweight, and fast.
  ☆1,096Updated 2 weeks ago
• lmstudio-ai / lms
  LM Studio CLI
  ☆3,934Updated last week
• leejet / stable-diffusion.cpp
  Diffusion model(SD,Flux,Wan,Qwen Image,Z-Image,...) inference in pure C/C++
  ☆4,691Updated this week
• turboderp / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆2,903Updated 2 years ago
• SillyTavern / SillyTavern-Extras
  Extensions API for SillyTavern.
  ☆653Updated 11 months ago
• lllyasviel / stable-diffusion-webui-forge
  ☆11,921Updated 4 months ago
• Haidra-Org / AI-Horde
  A crowdsourced distributed cluster for AI art and text generation
  ☆1,295Updated last week
• abetlen / llama-cpp-python
  Python bindings for llama.cpp
  ☆9,800Updated 3 months ago
• ParisNeo / lollms-webui
  Lord of Large Language and Multi modal Systems Web User Interface
  ☆4,765Updated 3 weeks ago
• pinokiocomputer / pinokio
  AI Browser
  ☆5,928Updated last week
• LykosAI / StabilityMatrix
  Multi-Platform Package Manager for Stable Diffusion
  ☆6,977Updated 2 weeks ago
• erew123 / alltalk_tts
  AllTalk is based on the Coqui TTS engine, similar to the Coqui_tts extension for Text generation webUI, however supports a variety of adv…
  ☆2,160Updated 4 months ago
• mcmonkeyprojects / SwarmUI
  SwarmUI (formerly StableSwarmUI), A Modular Stable Diffusion Web-User-Interface, with an emphasis on making powertools easily accessible,…
  ☆3,426Updated this week
• ggml-org / ggml
  Tensor library for machine learning
  ☆13,681Updated 2 weeks ago
• oobabooga / text-generation-webui-extensions
  ☆669Updated 3 weeks ago
• rsxdalv / TTS-WebUI
  A single Gradio + React WebUI with extensions for ACE-Step, Kimi Audio, Piper TTS, GPT-SoVITS, CosyVoice, XTTSv2, DIA, Kokoro, OpenVoice,…
  ☆2,800Updated 2 weeks ago
• henk717 / KoboldAI
  KoboldAI is generative AI software optimized for fictional use, but capable of much more!
  ☆417Updated 10 months ago
• SillyTavern / SillyTavern-Launcher
  Launcher scripts for SillyTavern and ST-Extras.
  ☆419Updated last week
• aphrodite-engine / aphrodite-engine
  Large-scale LLM inference engine
  ☆1,603Updated 2 weeks ago
• Sumandora / remove-refusals-with-transformers
  Implements harmful/harmless refusal removal using pure HF Transformers
  ☆1,352Updated last week
• mostlygeek / llama-swap
  Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc
  ☆1,977Updated this week
• ggozad / oterm
  the terminal client for Ollama
  ☆2,270Updated last month
• Vali-98 / ChatterUI
  Simple frontend for LLMs built in react-native.
  ☆1,942Updated last week