Alternatives and similar repositories for koboldcpp:

Users that are interested in koboldcpp are comparing it to the libraries listed below

• SillyTavern / SillyTavern
  LLM Frontend for Power Users.
  ☆9,399Updated this week
• TavernAI / TavernAI
  Atmospheric adventure chat for AI language models (KoboldAI, NovelAI, Pygmalion, OpenAI chatgpt, gpt-4)
  ☆2,261Updated last month
• KoboldAI / KoboldAI-Client
  For GGUF support, see KoboldCPP: https://github.com/LostRuins/koboldcpp
  ☆3,562Updated 4 months ago
• oobabooga / text-generation-webui
  A Gradio web UI for Large Language Models with support for multiple inference backends.
  ☆41,616Updated this week
• turboderp-org / exllamav2
  A fast inference library for running LLMs locally on modern consumer-class GPUs
  ☆3,845Updated last week
• abetlen / llama-cpp-python
  Python bindings for llama.cpp
  ☆8,420Updated last week
• theroyallab / tabbyAPI
  An OAI compatible exllamav2 API that's both lightweight and fast
  ☆733Updated this week
• turboderp / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆2,797Updated last year
• YellowRoseCx / koboldcpp-rocm
  AI Inferencing at the Edge. A simple one-file way to run various GGML models with KoboldAI's UI with AMD ROCm offloading
  ☆497Updated last week
• ParisNeo / lollms-webui
  Lord of Large Language and Multi modal Systems Web User Interface
  ☆4,439Updated this week
• leejet / stable-diffusion.cpp
  Stable Diffusion and Flux in pure C/C++
  ☆3,699Updated 3 weeks ago
• ggerganov / ggml
  Tensor library for machine learning
  ☆11,541Updated this week
• aphrodite-engine / aphrodite-engine
  Large-scale LLM inference engine
  ☆1,232Updated last week
• ggerganov / llama.cpp
  LLM inference in C/C++
  ☆70,826Updated this week
• erew123 / alltalk_tts
  AllTalk is based on the Coqui TTS engine, similar to the Coqui_tts extension for Text generation webUI, however supports a variety of adv…
  ☆1,320Updated last week
• SillyTavern / SillyTavern-Extras
  Extensions API for SillyTavern.
  ☆576Updated last month
• bigscience-workshop / petals
  🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
  ☆9,349Updated 4 months ago
• vladmandic / automatic
  SD.Next: All-in-one for AI generative image
  ☆5,921Updated this week
• pinokiocomputer / pinokio
  AI Browser
  ☆4,226Updated 2 weeks ago
• axolotl-ai-cloud / axolotl
  Go ahead and axolotl questions
  ☆8,293Updated this week
• nlpxucan / WizardLM
  LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath
  ☆9,312Updated 5 months ago
• oobabooga / text-generation-webui-extensions
  ☆581Updated last month
• rsxdalv / tts-generation-webui
  TTS Generation Web UI (Bark, MusicGen + AudioGen, Tortoise, RVC, Vocos, Demucs, SeamlessM4T, MAGNet, StyleTTS2, MMS, Stable Audio, Mars5,…
  ☆1,947Updated last month
• yl4579 / StyleTTS2
  StyleTTS 2: Towards Human-Level Text-to-Speech through Style Diffusion and Adversarial Training with Large Speech Language Models
  ☆5,265Updated 5 months ago
• h2oai / h2ogpt
  Private chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports oLLaMa, Mixtral, llama.cpp, and more. D…
  ☆11,594Updated this week
• Mozilla-Ocho / llamafile
  Distribute and run LLMs with a single file.
  ☆21,262Updated last week
• huggingface / text-generation-inference
  Large Language Model Text Generation Inference
  ☆9,592Updated this week
• neonbjb / tortoise-tts
  A multi-voice TTS system trained with an emphasis on quality
  ☆13,510Updated last month
• marella / ctransformers
  Python bindings for the Transformer models implemented in C/C++ using GGML library.
  ☆1,827Updated 11 months ago
• cocktailpeanut / dalai
  The simplest way to run LLaMA on your local machine
  ☆13,099Updated 6 months ago