Alternatives and similar repositories for koboldcpp

Users that are interested in koboldcpp are comparing it to the libraries listed below

• TavernAI / TavernAI
  Atmospheric adventure chat for AI language models (KoboldAI, NovelAI, Pygmalion, OpenAI chatgpt, gpt-4)
  ☆2,475Updated 2 weeks ago
• SillyTavern / SillyTavern
  LLM Frontend for Power Users.
  ☆15,569Updated this week
• KoboldAI / KoboldAI-Client
  For GGUF support, see KoboldCPP: https://github.com/LostRuins/koboldcpp
  ☆3,720Updated 5 months ago
• oobabooga / text-generation-webui
  LLM UI with advanced features, easy setup, and multiple backend support.
  ☆44,104Updated this week
• ParisNeo / lollms-webui
  Lord of Large Language and Multi modal Systems Web User Interface
  ☆4,690Updated this week
• cocktailpeanut / dalai
  The simplest way to run LLaMA on your local machine
  ☆13,072Updated last year
• theroyallab / tabbyAPI
  The official API server for Exllama. OAI compatible, lightweight, and fast.
  ☆990Updated this week
• YellowRoseCx / koboldcpp-rocm
  AI Inferencing at the Edge. A simple one-file way to run various GGML models with KoboldAI's UI with AMD ROCm offloading
  ☆642Updated last week
• abetlen / llama-cpp-python
  Python bindings for llama.cpp
  ☆9,276Updated last month
• antimatter15 / alpaca.cpp
  Locally run an Instruction-Tuned Chat-Style LLM
  ☆10,227Updated 2 years ago
• mudler / LocalAI
  The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on…
  ☆33,497Updated this week
• ggml-org / ggml
  Tensor library for machine learning
  ☆12,712Updated this week
• turboderp-org / exllamav2
  A fast inference library for running LLMs locally on modern consumer-class GPUs
  ☆4,216Updated 3 weeks ago
• turboderp / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆2,883Updated last year
• SillyTavern / SillyTavern-Extras
  Extensions API for SillyTavern.
  ☆631Updated 6 months ago
• nlpxucan / WizardLM
  LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath
  ☆9,421Updated 3 weeks ago
• vladmandic / sdnext
  SD.Next: All-in-one WebUI for AI generative image and video creation
  ☆6,418Updated this week
• leejet / stable-diffusion.cpp
  Stable Diffusion and Flux in pure C/C++
  ☆4,175Updated 3 months ago
• henk717 / KoboldAI
  KoboldAI is generative AI software optimized for fictional use, but capable of much more!
  ☆410Updated 5 months ago
• kwaroran / RisuAI
  Make your own story. User-friendly software for LLM roleplaying
  ☆1,064Updated last week
• ggml-org / llama.cpp
  LLM inference in C/C++
  ☆82,170Updated this week
• lllyasviel / stable-diffusion-webui-forge
  ☆11,049Updated 2 weeks ago
• LAION-AI / Open-Assistant
  OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamical…
  ☆37,391Updated 10 months ago
• aphrodite-engine / aphrodite-engine
  Large-scale LLM inference engine
  ☆1,457Updated last week
• Stability-AI / StableLM
  StableLM: Stability AI Language Models
  ☆15,826Updated last year
• lm-sys / FastChat
  An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
  ☆38,770Updated 3 weeks ago
• Haidra-Org / AI-Horde
  A crowdsourced distributed cluster for AI art and text generation
  ☆1,238Updated this week
• ggml-org / whisper.cpp
  Port of OpenAI's Whisper model in C/C++
  ☆41,115Updated this week
• oobabooga / text-generation-webui-extensions
  ☆641Updated this week
• oobabooga / one-click-installers
  Simplified installers for oobabooga/text-generation-webui.
  ☆563Updated last year