Alternatives and similar repositories for koboldcpp

Users that are interested in koboldcpp are comparing it to the libraries listed below

• oobabooga / text-generation-webui
  A Gradio web UI for Large Language Models with support for multiple inference backends.
  ☆43,560Updated this week
• KoboldAI / KoboldAI-Client
  For GGUF support, see KoboldCPP: https://github.com/LostRuins/koboldcpp
  ☆3,667Updated 4 months ago
• turboderp-org / exllamav2
  A fast inference library for running LLMs locally on modern consumer-class GPUs
  ☆4,166Updated last week
• leejet / stable-diffusion.cpp
  Stable Diffusion and Flux in pure C/C++
  ☆4,064Updated 2 months ago
• abetlen / llama-cpp-python
  Python bindings for llama.cpp
  ☆9,085Updated last week
• TavernAI / TavernAI
  Atmospheric adventure chat for AI language models (KoboldAI, NovelAI, Pygmalion, OpenAI chatgpt, gpt-4)
  ☆2,426Updated last month
• turboderp / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆2,873Updated last year
• ParisNeo / lollms-webui
  Lord of Large Language and Multi modal Systems Web User Interface
  ☆4,650Updated this week
• YellowRoseCx / koboldcpp-rocm
  AI Inferencing at the Edge. A simple one-file way to run various GGML models with KoboldAI's UI with AMD ROCm offloading
  ☆607Updated last month
• vladmandic / sdnext
  SD.Next: All-in-one WebUI for AI generative image and video creation
  ☆6,289Updated this week
• SillyTavern / SillyTavern
  LLM Frontend for Power Users.
  ☆14,361Updated this week
• theroyallab / tabbyAPI
  The official API server for Exllama. OAI compatible, lightweight, and fast.
  ☆944Updated this week
• oobabooga / text-generation-webui-extensions
  ☆628Updated last week
• lllyasviel / stable-diffusion-webui-forge
  ☆10,754Updated last week
• ggml-org / llama.cpp
  LLM inference in C/C++
  ☆79,738Updated this week
• mcmonkeyprojects / SwarmUI
  SwarmUI (formerly StableSwarmUI), A Modular Stable Diffusion Web-User-Interface, with an emphasis on making powertools easily accessible,…
  ☆2,515Updated this week
• SillyTavern / SillyTavern-Extras
  Extensions API for SillyTavern.
  ☆613Updated 5 months ago
• erew123 / alltalk_tts
  AllTalk is based on the Coqui TTS engine, similar to the Coqui_tts extension for Text generation webUI, however supports a variety of adv…
  ☆1,786Updated 3 weeks ago
• invoke-ai / InvokeAI
  Invoke is a leading creative engine for Stable Diffusion models, empowering professionals, artists, and enthusiasts to generate and creat…
  ☆25,082Updated this week
• Stability-AI / StableSwarmUI
  StableSwarmUI, A Modular Stable Diffusion Web-User-Interface, with an emphasis on making powertools easily accessible, high performance, …
  ☆4,783Updated 2 months ago
• nlpxucan / WizardLM
  LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath
  ☆9,393Updated 9 months ago
• ggml-org / ggml
  Tensor library for machine learning
  ☆12,477Updated last week
• aphrodite-engine / aphrodite-engine
  Large-scale LLM inference engine
  ☆1,419Updated this week
• kwaroran / RisuAI
  Make your own story. User-friendly software for LLM roleplaying
  ☆1,019Updated this week
• AutoGPTQ / AutoGPTQ
  An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
  ☆4,838Updated last month
• Mozilla-Ocho / llamafile
  Distribute and run LLMs with a single file.
  ☆22,365Updated 3 weeks ago
• mudler / LocalAI
  The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on…
  ☆32,566Updated this week
• antimatter15 / alpaca.cpp
  Locally run an Instruction-Tuned Chat-Style LLM
  ☆10,231Updated 2 years ago
• qwopqwop200 / GPTQ-for-LLaMa
  4 bits quantization of LLaMA using GPTQ
  ☆3,050Updated 10 months ago
• m-bain / whisperX
  WhisperX: Automatic Speech Recognition with Word-level Timestamps (& Diarization)
  ☆15,622Updated last week