LostRuins / koboldcppLinks
Run GGUF models easily with a KoboldAI UI. One File. Zero Install.
☆8,071Updated this week
Alternatives and similar repositories for koboldcpp
Users that are interested in koboldcpp are comparing it to the libraries listed below
Sorting:
- For GGUF support, see KoboldCPP: https://github.com/LostRuins/koboldcpp☆3,772Updated 7 months ago
- AI Inferencing at the Edge. A simple one-file way to run various GGML models with KoboldAI's UI with AMD ROCm offloading☆682Updated 2 weeks ago
- Atmospheric adventure chat for AI language models (KoboldAI, NovelAI, Pygmalion, OpenAI chatgpt, gpt-4)☆2,525Updated last month
- LLM UI with advanced features, easy setup, and multiple backend support.☆44,800Updated this week
- The official API server for Exllama. OAI compatible, lightweight, and fast.☆1,039Updated last week
- A fast inference library for running LLMs locally on modern consumer-class GPUs☆4,290Updated last week
- Lord of Large Language and Multi modal Systems Web User Interface☆4,742Updated last week
- LLM Frontend for Power Users.☆17,753Updated this week
- Python bindings for llama.cpp☆9,515Updated 2 weeks ago
- Stable Diffusion and Flux in pure C/C++☆4,331Updated 3 weeks ago
- Extensions API for SillyTavern.☆640Updated 8 months ago
- ☆11,498Updated 3 weeks ago
- A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.☆2,897Updated last year
- SwarmUI (formerly StableSwarmUI), A Modular Stable Diffusion Web-User-Interface, with an emphasis on making powertools easily accessible,…☆3,034Updated this week
- LLM inference in C/C++☆85,425Updated this week
- ☆655Updated last week
- Large-scale LLM inference engine☆1,530Updated this week
- A crowdsourced distributed cluster for AI art and text generation☆1,270Updated last month
- Model swapping for llama.cpp (or any local OpenAPI compatible server)☆1,370Updated last week
- AllTalk is based on the Coqui TTS engine, similar to the Coqui_tts extension for Text generation webUI, however supports a variety of adv…☆1,994Updated last month
- The simplest way to run Alpaca (and other LLaMA-based local LLMs) on your own computer☆1,315Updated last year
- SD.Next: All-in-one WebUI for AI generative image and video creation☆6,554Updated this week
- Local AI API Platform☆2,761Updated last month
- KoboldAI is generative AI software optimized for fictional use, but capable of much more!☆415Updated 7 months ago
- Distribute and run LLMs with a single file.☆23,002Updated last month
- A single Gradio + React WebUI with extensions for ACE-Step, Kimi Audio, Piper TTS, GPT-SoVITS, CosyVoice, XTTSv2, DIA, Kokoro, OpenVoice,…☆2,465Updated this week
- Fast stable diffusion on CPU and AI PC☆1,766Updated last week
- AI Agnostic (Multi-user and Multi-bot) Chat with Fictional Characters. Designed with scale in mind.☆629Updated this week
- LM Studio CLI☆3,602Updated this week
- Amica is an open source interface for interactive communication with 3D characters with voice synthesis and speech recognition.☆1,060Updated last month