cyan2k / llama.cppLinks
LLM inference in C/C++
☆23Updated last year
Alternatives and similar repositories for llama.cpp
Users that are interested in llama.cpp are comparing it to the libraries listed below
Sorting:
- 33B Chinese LLM, DPO QLORA, 100K context, AirLLM 70B inference with single 4GB GPU☆13Updated last year
- A cli app for experimenting with kokoro voice creating and mixing using the available voices to interpolate new ones☆36Updated last year
- Loader extension for tabbyAPI in SillyTavern☆26Updated 7 months ago
- V.I.S.O.R., my in-development AI-powered voice assistant with integrated memory!☆36Updated 2 months ago
- "Pacha" TUI (Text User Interface) is a JavaScript application that utilizes the "blessed" library. It serves as a frontend for llama.cpp …☆36Updated 2 years ago
- RetroChat is a powerful command-line interface for interacting with various AI language models. It provides a seamless experience for eng…☆84Updated 6 months ago
- fast state-of-the-art speech models and a runtime that runs anywhere 💥☆57Updated 7 months ago
- Writing Extension for Text Generation WebUI☆64Updated 6 months ago
- "a towel is about the most massively useful thing an interstellar AI hitchhiker can have"☆48Updated last year
- Generate a llama-quantize command to copy the quantization parameters of any GGUF☆30Updated 2 weeks ago
- ☆90Updated last month
- No-messing-around sh client for llama.cpp's server☆30Updated last year
- Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…☆88Updated this week
- klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs☆86Updated last year
- Accepts a Hugging Face model URL, automatically downloads and quantizes it using Bits and Bytes.☆38Updated last year
- LLM Divergent Thinking Creativity Benchmark. LLMs generate 25 unique words that start with a given letter with no connections to each oth…☆35Updated 10 months ago
- Editor with LLM generation tree exploration☆83Updated 11 months ago
- SLOP Detector and analyzer based on dictionary for shareGPT JSON and text☆81Updated last week
- A frontend for creative writing with LLMs☆146Updated last year
- Serving LLMs in the HF-Transformers format via a PyFlask API☆72Updated last year
- ☆32Updated 2 years ago
- A proxy that hosts multiple single-model runners such as LLama.cpp and vLLM☆12Updated 8 months ago
- This repository is about implementing The Personality Cores Conversation System originally developed by Aperture Science, Inc. in the Por…☆24Updated last year
- Chat WebUI is an easy-to-use user interface for interacting with AI, and it comes with multiple useful built-in tools such as web search …☆49Updated 5 months ago
- A simple speech-to-text and text-to-speech AI chatbot that can be run fully offline.☆45Updated 2 years ago
- Reddit-Nemesis is a Reddit bot that disagrees to any post, sparking debate and keeping conversations lively.☆49Updated 2 weeks ago
- Adding a multi-text multi-speaker script (diffe) that is based on a script from asiff00 on issue 61 for Sesame: A Conversational Speech G…☆26Updated 10 months ago
- Thematic Generalization Benchmark: measures how effectively various LLMs can infer a narrow or specific "theme" (category/rule) from a sm…☆63Updated 4 months ago
- LLM backed Fantasy Tribe Game☆19Updated last year
- Attend - to what matters.☆17Updated 11 months ago