LostRuins / koboldcppLinks
Run GGUF models easily with a KoboldAI UI. One File. Zero Install.
☆7,459Updated this week
Alternatives and similar repositories for koboldcpp
Users that are interested in koboldcpp are comparing it to the libraries listed below
Sorting:
- For GGUF support, see KoboldCPP: https://github.com/LostRuins/koboldcpp☆3,686Updated 4 months ago
- LLM Frontend for Power Users.☆14,979Updated this week
- Atmospheric adventure chat for AI language models (KoboldAI, NovelAI, Pygmalion, OpenAI chatgpt, gpt-4)☆2,451Updated 3 weeks ago
- A fast inference library for running LLMs locally on modern consumer-class GPUs☆4,202Updated this week
- A Gradio web UI for Large Language Models with support for multiple inference backends.☆43,819Updated this week
- Python bindings for llama.cpp☆9,193Updated last month
- AI Inferencing at the Edge. A simple one-file way to run various GGML models with KoboldAI's UI with AMD ROCm offloading☆624Updated last week
- The official API server for Exllama. OAI compatible, lightweight, and fast.☆969Updated last week
- Stable Diffusion and Flux in pure C/C++☆4,129Updated 2 months ago
- A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.☆2,878Updated last year
- ☆632Updated last week
- Extensions API for SillyTavern.☆623Updated 5 months ago
- KoboldAI is generative AI software optimized for fictional use, but capable of much more!☆406Updated 4 months ago
- Lord of Large Language and Multi modal Systems Web User Interface☆4,667Updated this week
- Tensor library for machine learning☆12,640Updated this week
- SD.Next: All-in-one WebUI for AI generative image and video creation☆6,350Updated this week
- Large-scale LLM inference engine☆1,440Updated last week
- LLM inference in C/C++☆81,264Updated this week
- Port of OpenAI's Whisper model in C/C++☆40,508Updated this week
- StableSwarmUI, A Modular Stable Diffusion Web-User-Interface, with an emphasis on making powertools easily accessible, high performance, …☆4,807Updated 3 months ago
- AllTalk is based on the Coqui TTS engine, similar to the Coqui_tts extension for Text generation webUI, however supports a variety of adv…☆1,835Updated last month
- Faster Whisper transcription with CTranslate2☆16,408Updated this week
- Distribute and run LLMs with a single file.☆22,546Updated 3 weeks ago
- LM Studio CLI☆3,149Updated this week
- SwarmUI (formerly StableSwarmUI), A Modular Stable Diffusion Web-User-Interface, with an emphasis on making powertools easily accessible,…☆2,614Updated this week
- AI Agnostic (Multi-user and Multi-bot) Chat with Fictional Characters. Designed with scale in mind.☆600Updated last week
- ☆10,930Updated 2 weeks ago
- Universal LLM Deployment Engine with ML Compilation☆20,747Updated this week
- Fast stable diffusion on CPU☆1,705Updated 3 weeks ago
- Make your own story. User-friendly software for LLM roleplaying☆1,045Updated this week