LostRuins / koboldcpp
Run GGUF models easily with a KoboldAI UI. One File. Zero Install.
☆6,897Updated this week
Alternatives and similar repositories for koboldcpp:
Users that are interested in koboldcpp are comparing it to the libraries listed below
- For GGUF support, see KoboldCPP: https://github.com/LostRuins/koboldcpp☆3,633Updated 2 months ago
- LLM Frontend for Power Users.☆12,830Updated this week
- A fast inference library for running LLMs locally on modern consumer-class GPUs☆4,078Updated 2 weeks ago
- A Gradio web UI for Large Language Models with support for multiple inference backends.☆43,003Updated this week
- Atmospheric adventure chat for AI language models (KoboldAI, NovelAI, Pygmalion, OpenAI chatgpt, gpt-4)☆2,374Updated last week
- SD.Next: All-in-one for AI generative image☆6,137Updated this week
- AI Inferencing at the Edge. A simple one-file way to run various GGML models with KoboldAI's UI with AMD ROCm offloading☆577Updated last week
- Extensions API for SillyTavern.☆595Updated 3 months ago
- Python bindings for llama.cpp☆8,865Updated this week
- An OAI compatible exllamav2 API that's both lightweight and fast☆873Updated last week
- Stable Diffusion and Flux in pure C/C++☆3,949Updated 3 weeks ago
- LLM inference in C/C++☆77,219Updated this week
- Tensor library for machine learning☆12,206Updated this week
- Invoke is a leading creative engine for Stable Diffusion models, empowering professionals, artists, and enthusiasts to generate and creat…☆24,724Updated this week
- AllTalk is based on the Coqui TTS engine, similar to the Coqui_tts extension for Text generation webUI, however supports a variety of adv…☆1,635Updated last week
- KoboldAI is generative AI software optimized for fictional use, but capable of much more!☆395Updated 2 months ago
- The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on…☆31,265Updated this week
- Curated list of useful LLM / Analytics / Datascience resources☆2,230Updated last month
- SwarmUI (formerly StableSwarmUI), A Modular Stable Diffusion Web-User-Interface, with an emphasis on making powertools easily accessible,…☆2,279Updated this week
- Lord of Large Language and Multi modal Systems Web User Interface☆4,581Updated this week
- A crowdsourced distributed cluster for AI art and text generation☆1,176Updated last month
- Large-scale LLM inference engine☆1,366Updated this week
- ☆10,302Updated 3 weeks ago
- Amica is an open source interface for interactive communication with 3D characters with voice synthesis and speech recognition.☆916Updated this week
- A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.☆2,845Updated last year
- Easy Docker setup for Stable Diffusion with user-friendly UI☆7,082Updated 7 months ago
- Make your own story. User-friendly software for LLM roleplaying☆950Updated this week
- ☆612Updated last month
- AI Browser☆4,746Updated this week
- AI Agnostic (Multi-user and Multi-bot) Chat with Fictional Characters. Designed with scale in mind.☆583Updated this week