Alternatives and similar repositories for koboldcpp:

Users that are interested in koboldcpp are comparing it to the libraries listed below

• SillyTavern / SillyTavern
  LLM Frontend for Power Users.
  ☆11,337Updated this week
• oobabooga / text-generation-webui
  A Gradio web UI for Large Language Models with support for multiple inference backends.
  ☆42,540Updated this week
• YellowRoseCx / koboldcpp-rocm
  AI Inferencing at the Edge. A simple one-file way to run various GGML models with KoboldAI's UI with AMD ROCm offloading
  ☆539Updated this week
• KoboldAI / KoboldAI-Client
  For GGUF support, see KoboldCPP: https://github.com/LostRuins/koboldcpp
  ☆3,605Updated last month
• TavernAI / TavernAI
  Atmospheric adventure chat for AI language models (KoboldAI, NovelAI, Pygmalion, OpenAI chatgpt, gpt-4)
  ☆2,303Updated 2 months ago
• abetlen / llama-cpp-python
  Python bindings for llama.cpp
  ☆8,647Updated 3 weeks ago
• vladmandic / sdnext
  SD.Next: All-in-one for AI generative image
  ☆6,017Updated this week
• ggerganov / whisper.cpp
  Port of OpenAI's Whisper model in C/C++
  ☆37,876Updated this week
• Acly / krita-ai-diffusion
  Streamlined interface for generating images with AI in Krita. Inpaint and outpaint with optional text prompt, no tweaking required.
  ☆7,926Updated this week
• leejet / stable-diffusion.cpp
  Stable Diffusion and Flux in pure C/C++
  ☆3,828Updated 2 weeks ago
• theroyallab / tabbyAPI
  An OAI compatible exllamav2 API that's both lightweight and fast
  ☆788Updated this week
• SillyTavern / SillyTavern-Extras
  Extensions API for SillyTavern.
  ☆589Updated 2 months ago
• ParisNeo / lollms-webui
  Lord of Large Language and Multi modal Systems Web User Interface
  ☆4,528Updated this week
• turboderp-org / exllamav2
  A fast inference library for running LLMs locally on modern consumer-class GPUs
  ☆3,970Updated last week
• ggml-org / llama.cpp
  LLM inference in C/C++
  ☆74,674Updated this week
• lllyasviel / stable-diffusion-webui-forge
  ☆9,774Updated this week
• erew123 / alltalk_tts
  AllTalk is based on the Coqui TTS engine, similar to the Coqui_tts extension for Text generation webUI, however supports a variety of adv…
  ☆1,500Updated last week
• LykosAI / StabilityMatrix
  Multi-Platform Package Manager for Stable Diffusion
  ☆5,426Updated this week
• invoke-ai / InvokeAI
  Invoke is a leading creative engine for Stable Diffusion models, empowering professionals, artists, and enthusiasts to generate and creat…
  ☆24,484Updated this week
• comfyanonymous / ComfyUI
  The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface.
  ☆67,685Updated this week
• ggml-org / ggml
  Tensor library for machine learning
  ☆11,902Updated last week
• turboderp / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆2,823Updated last year
• mudler / LocalAI
  The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on…
  ☆30,485Updated this week
• AbdBarho / stable-diffusion-webui-docker
  Easy Docker setup for Stable Diffusion with user-friendly UI
  ☆7,005Updated 6 months ago
• agnaistic / agnai
  AI Agnostic (Multi-user and Multi-bot) Chat with Fictional Characters. Designed with scale in mind.
  ☆570Updated last week
• SYSTRAN / faster-whisper
  Faster Whisper transcription with CTranslate2
  ☆14,234Updated last month
• ltdrdata / ComfyUI-Manager
  ComfyUI-Manager is an extension designed to enhance the usability of ComfyUI. It offers management functions to install, remove, disable,…
  ☆8,658Updated this week
• antimatter15 / alpaca.cpp
  Locally run an Instruction-Tuned Chat-Style LLM
  ☆10,236Updated last year
• huggingface / chat-ui
  Open source codebase powering the HuggingChat app
  ☆8,221Updated this week
• henk717 / KoboldAI
  KoboldAI is generative AI software optimized for fictional use, but capable of much more!
  ☆386Updated last month