Alternatives and similar repositories for koboldcpp

Users that are interested in koboldcpp are comparing it to the libraries listed below

• KoboldAI / KoboldAI-Client
  For GGUF support, see KoboldCPP: https://github.com/LostRuins/koboldcpp
  ☆3,755Updated 6 months ago
• TavernAI / TavernAI
  Atmospheric adventure chat for AI language models (KoboldAI, NovelAI, Pygmalion, OpenAI chatgpt, gpt-4)
  ☆2,507Updated 3 weeks ago
• YellowRoseCx / koboldcpp-rocm
  AI Inferencing at the Edge. A simple one-file way to run various GGML models with KoboldAI's UI with AMD ROCm offloading
  ☆663Updated this week
• turboderp-org / exllamav2
  A fast inference library for running LLMs locally on modern consumer-class GPUs
  ☆4,258Updated 3 weeks ago
• theroyallab / tabbyAPI
  The official API server for Exllama. OAI compatible, lightweight, and fast.
  ☆1,020Updated this week
• oobabooga / text-generation-webui
  LLM UI with advanced features, easy setup, and multiple backend support.
  ☆44,592Updated this week
• SillyTavern / SillyTavern
  LLM Frontend for Power Users.
  ☆17,073Updated this week
• turboderp / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆2,894Updated last year
• leejet / stable-diffusion.cpp
  Stable Diffusion and Flux in pure C/C++
  ☆4,293Updated this week
• SillyTavern / SillyTavern-Extras
  Extensions API for SillyTavern.
  ☆636Updated 7 months ago
• ParisNeo / lollms-webui
  Lord of Large Language and Multi modal Systems Web User Interface
  ☆4,725Updated 2 weeks ago
• Haidra-Org / AI-Horde
  A crowdsourced distributed cluster for AI art and text generation
  ☆1,256Updated 3 weeks ago
• oobabooga / text-generation-webui-extensions
  ☆648Updated 2 weeks ago
• abetlen / llama-cpp-python
  Python bindings for llama.cpp
  ☆9,426Updated 2 weeks ago
• aphrodite-engine / aphrodite-engine
  Large-scale LLM inference engine
  ☆1,492Updated last week
• mudler / LocalAI
  The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on…
  ☆34,402Updated this week
• henk717 / KoboldAI
  KoboldAI is generative AI software optimized for fictional use, but capable of much more!
  ☆414Updated 6 months ago
• erew123 / alltalk_tts
  AllTalk is based on the Coqui TTS engine, similar to the Coqui_tts extension for Text generation webUI, however supports a variety of adv…
  ☆1,960Updated 3 weeks ago
• vladmandic / sdnext
  SD.Next: All-in-one WebUI for AI generative image and video creation
  ☆6,503Updated this week
• menloresearch / cortex.cpp
  Local AI API Platform
  ☆2,765Updated last month
• SillyTavern / SillyTavern-Launcher
  Launcher scripts for SillyTavern and ST-Extras.
  ☆372Updated this week
• kwaroran / RisuAI
  Make your own story. User-friendly software for LLM roleplaying
  ☆1,100Updated last week
• mcmonkeyprojects / SwarmUI
  SwarmUI (formerly StableSwarmUI), A Modular Stable Diffusion Web-User-Interface, with an emphasis on making powertools easily accessible,…
  ☆2,917Updated this week
• Vali-98 / ChatterUI
  Simple frontend for LLMs built in react-native.
  ☆1,678Updated this week
• lmg-anon / mikupad
  LLM Frontend in a single html file
  ☆533Updated 6 months ago
• semperai / amica
  Amica is an open source interface for interactive communication with 3D characters with voice synthesis and speech recognition.
  ☆1,025Updated 2 weeks ago
• pinokiocomputer / pinokio
  AI Browser
  ☆5,381Updated this week
• ItsPi3141 / alpaca-electron
  The simplest way to run Alpaca (and other LLaMA-based local LLMs) on your own computer
  ☆1,313Updated last year
• RWKV / rwkv.cpp
  INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
  ☆1,537Updated 4 months ago
• agnaistic / agnai
  AI Agnostic (Multi-user and Multi-bot) Chat with Fictional Characters. Designed with scale in mind.
  ☆618Updated last week