Alternatives and similar repositories for koboldcpp:

Users that are interested in koboldcpp are comparing it to the libraries listed below

• TavernAI / TavernAI
  Atmospheric adventure chat for AI language models (KoboldAI, NovelAI, Pygmalion, OpenAI chatgpt, gpt-4)
  ☆2,402Updated last month
• YellowRoseCx / koboldcpp-rocm
  AI Inferencing at the Edge. A simple one-file way to run various GGML models with KoboldAI's UI with AMD ROCm offloading
  ☆588Updated last week
• KoboldAI / KoboldAI-Client
  For GGUF support, see KoboldCPP: https://github.com/LostRuins/koboldcpp
  ☆3,650Updated 3 months ago
• SillyTavern / SillyTavern
  LLM Frontend for Power Users.
  ☆13,745Updated this week
• oobabooga / text-generation-webui
  A Gradio web UI for Large Language Models with support for multiple inference backends.
  ☆43,274Updated this week
• turboderp-org / exllamav2
  A fast inference library for running LLMs locally on modern consumer-class GPUs
  ☆4,125Updated this week
• ParisNeo / lollms-webui
  Lord of Large Language and Multi modal Systems Web User Interface
  ☆4,617Updated this week
• rhasspy / piper
  A fast, local neural text to speech system
  ☆8,600Updated last month
• SillyTavern / SillyTavern-Extras
  Extensions API for SillyTavern.
  ☆606Updated 4 months ago
• theroyallab / tabbyAPI
  An OAI compatible exllamav2 API that's both lightweight and fast
  ☆915Updated this week
• oobabooga / text-generation-webui-extensions
  ☆622Updated last week
• erew123 / alltalk_tts
  AllTalk is based on the Coqui TTS engine, similar to the Coqui_tts extension for Text generation webUI, however supports a variety of adv…
  ☆1,718Updated 2 weeks ago
• Haidra-Org / AI-Horde
  A crowdsourced distributed cluster for AI art and text generation
  ☆1,195Updated last week
• abetlen / llama-cpp-python
  Python bindings for llama.cpp
  ☆8,988Updated last week
• vladmandic / sdnext
  SD.Next: All-in-one for AI generative image
  ☆6,208Updated this week
• rsxdalv / tts-generation-webui
  TTS Generation Web UI (Bark, MusicGen + AudioGen, Tortoise, RVC, Vocos, Demucs, SeamlessM4T, MAGNet, StyleTTS2, MMS, Stable Audio, Mars5,…
  ☆2,110Updated this week
• henk717 / KoboldAI
  KoboldAI is generative AI software optimized for fictional use, but capable of much more!
  ☆403Updated 3 months ago
• leejet / stable-diffusion.cpp
  Stable Diffusion and Flux in pure C/C++
  ☆4,023Updated last month
• agnaistic / agnai
  AI Agnostic (Multi-user and Multi-bot) Chat with Fictional Characters. Designed with scale in mind.
  ☆588Updated last week
• bigscience-workshop / petals
  🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
  ☆9,582Updated 7 months ago
• suno-ai / bark
  🔊 Text-Prompted Generative Audio Model
  ☆37,491Updated 8 months ago
• ggml-org / llama.cpp
  LLM inference in C/C++
  ☆78,494Updated this week
• kwaroran / RisuAI
  Make your own story. User-friendly software for LLM roleplaying
  ☆976Updated last week
• oobabooga / one-click-installers
  Simplified installers for oobabooga/text-generation-webui.
  ☆559Updated last year
• mcmonkeyprojects / SwarmUI
  SwarmUI (formerly StableSwarmUI), A Modular Stable Diffusion Web-User-Interface, with an emphasis on making powertools easily accessible,…
  ☆2,391Updated this week
• turboderp / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆2,863Updated last year
• invoke-ai / InvokeAI
  Invoke is a leading creative engine for Stable Diffusion models, empowering professionals, artists, and enthusiasts to generate and creat…
  ☆24,908Updated this week
• antimatter15 / alpaca.cpp
  Locally run an Instruction-Tuned Chat-Style LLM
  ☆10,235Updated 2 years ago
• aphrodite-engine / aphrodite-engine
  Large-scale LLM inference engine
  ☆1,384Updated this week
• ggml-org / ggml
  Tensor library for machine learning
  ☆12,350Updated this week