ThomasBaruzier / llama.cpp-helper
Makes llama.cpp easy to use.
☆12Updated last year
Alternatives and similar repositories for llama.cpp-helper:
Users that are interested in llama.cpp-helper are comparing it to the libraries listed below
- BUD-E (Buddy) is an open-source voice assistant framework that facilitates seamless interaction with AI models and APIs, enabling the cre…☆33Updated 9 months ago
- Accepts a Hugging Face model URL, automatically downloads and quantizes it using Bits and Bytes.☆38Updated last year
- Experimental sampler to make LLMs more creative☆30Updated last year
- GPT-2 small trained on phi-like data☆66Updated last year
- Just a simple HowTo for https://github.com/johnsmith0031/alpaca_lora_4bit☆31Updated last year
- LLM backed Fantasy Tribe Game☆18Updated 5 months ago
- idea: https://github.com/nyxkrage/ebook-groupchat/☆86Updated 8 months ago
- run ollama & gguf easily with a single command☆50Updated 11 months ago
- Let's create synthetic textbooks together :)☆74Updated last year
- Like system requirements lab but for LLMs☆31Updated last year
- Text generation in Python, as easy as possible☆58Updated this week
- Mistral7B playing DOOM☆28Updated last year
- SPLAA is an AI assistant framework that utilizes voice recognition, text-to-speech, and tool-calling capabilities to provide a conversati…☆27Updated 3 months ago
- SLOP Detector and analyzer based on dictionary for shareGPT JSON and text☆66Updated 5 months ago
- Local LLM inference & management server with built-in OpenAI API☆31Updated last year
- After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around…☆54Updated 8 months ago
- Terminal Voice Assistant is a powerful and flexible tool designed to help users interact with their terminal using natural language comma…☆18Updated 10 months ago
- A simple speech-to-text and text-to-speech AI chatbot that can be run fully offline.☆44Updated last year
- Creates an Langchain Agent which uses the WebUI's API and Wikipedia to work☆74Updated last year
- Traing PRO extension for oobabooga WebUI - recent dev version☆48Updated 3 months ago
- ☆39Updated last year
- Experimental LLM Inference UX to aid in creative writing☆114Updated 4 months ago
- ☆60Updated this week
- Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…☆43Updated last year
- Dynamic parameter modulation for oobabooga's text-generation-webui that adjusts generation parameters to better mirror user affect.☆35Updated last year
- A Qt GUI for large language models☆42Updated last year
- oobabooga extension - Experimental sampler to make LLMs more creative☆23Updated last year
- ☆31Updated last year
- Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…☆56Updated 2 months ago
- an auto-sleeping and -waking framework around llama.cpp☆11Updated 2 months ago