Alternatives and similar repositories for koboldcpp

Users that are interested in koboldcpp are comparing it to the libraries listed below

• KoboldAI / KoboldAI-Client
  For GGUF support, see KoboldCPP: https://github.com/LostRuins/koboldcpp
  ☆3,772Updated 7 months ago
• YellowRoseCx / koboldcpp-rocm
  AI Inferencing at the Edge. A simple one-file way to run various GGML models with KoboldAI's UI with AMD ROCm offloading
  ☆682Updated 2 weeks ago
• TavernAI / TavernAI
  Atmospheric adventure chat for AI language models (KoboldAI, NovelAI, Pygmalion, OpenAI chatgpt, gpt-4)
  ☆2,525Updated last month
• oobabooga / text-generation-webui
  LLM UI with advanced features, easy setup, and multiple backend support.
  ☆44,800Updated this week
• theroyallab / tabbyAPI
  The official API server for Exllama. OAI compatible, lightweight, and fast.
  ☆1,039Updated last week
• turboderp-org / exllamav2
  A fast inference library for running LLMs locally on modern consumer-class GPUs
  ☆4,290Updated last week
• ParisNeo / lollms-webui
  Lord of Large Language and Multi modal Systems Web User Interface
  ☆4,742Updated last week
• SillyTavern / SillyTavern
  LLM Frontend for Power Users.
  ☆17,753Updated this week
• abetlen / llama-cpp-python
  Python bindings for llama.cpp
  ☆9,515Updated 2 weeks ago
• leejet / stable-diffusion.cpp
  Stable Diffusion and Flux in pure C/C++
  ☆4,331Updated 3 weeks ago
• SillyTavern / SillyTavern-Extras
  Extensions API for SillyTavern.
  ☆640Updated 8 months ago
• lllyasviel / stable-diffusion-webui-forge
  ☆11,498Updated 3 weeks ago
• turboderp / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆2,897Updated last year
• mcmonkeyprojects / SwarmUI
  SwarmUI (formerly StableSwarmUI), A Modular Stable Diffusion Web-User-Interface, with an emphasis on making powertools easily accessible,…
  ☆3,034Updated this week
• ggml-org / llama.cpp
  LLM inference in C/C++
  ☆85,425Updated this week
• oobabooga / text-generation-webui-extensions
  ☆655Updated last week
• aphrodite-engine / aphrodite-engine
  Large-scale LLM inference engine
  ☆1,530Updated this week
• Haidra-Org / AI-Horde
  A crowdsourced distributed cluster for AI art and text generation
  ☆1,270Updated last month
• mostlygeek / llama-swap
  Model swapping for llama.cpp (or any local OpenAPI compatible server)
  ☆1,370Updated last week
• erew123 / alltalk_tts
  AllTalk is based on the Coqui TTS engine, similar to the Coqui_tts extension for Text generation webUI, however supports a variety of adv…
  ☆1,994Updated last month
• ItsPi3141 / alpaca-electron
  The simplest way to run Alpaca (and other LLaMA-based local LLMs) on your own computer
  ☆1,315Updated last year
• vladmandic / sdnext
  SD.Next: All-in-one WebUI for AI generative image and video creation
  ☆6,554Updated this week
• menloresearch / cortex.cpp
  Local AI API Platform
  ☆2,761Updated last month
• henk717 / KoboldAI
  KoboldAI is generative AI software optimized for fictional use, but capable of much more!
  ☆415Updated 7 months ago
• Mozilla-Ocho / llamafile
  Distribute and run LLMs with a single file.
  ☆23,002Updated last month
• rsxdalv / TTS-WebUI
  A single Gradio + React WebUI with extensions for ACE-Step, Kimi Audio, Piper TTS, GPT-SoVITS, CosyVoice, XTTSv2, DIA, Kokoro, OpenVoice,…
  ☆2,465Updated this week
• rupeshs / fastsdcpu
  Fast stable diffusion on CPU and AI PC
  ☆1,766Updated last week
• agnaistic / agnai
  AI Agnostic (Multi-user and Multi-bot) Chat with Fictional Characters. Designed with scale in mind.
  ☆629Updated this week
• lmstudio-ai / lms
  LM Studio CLI
  ☆3,602Updated this week
• semperai / amica
  Amica is an open source interface for interactive communication with 3D characters with voice synthesis and speech recognition.
  ☆1,060Updated last month