ThomasBaruzier / llama.cpp-helperLinks
Makes llama.cpp easy to use.
☆12Updated 2 months ago
Alternatives and similar repositories for llama.cpp-helper
Users that are interested in llama.cpp-helper are comparing it to the libraries listed below
Sorting:
- Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA☆123Updated 2 years ago
- Simple and fast server for GPTQ-quantized LLaMA inference☆24Updated 2 years ago
- Automated prompting and scoring framework to evaluate LLMs using updated human knowledge prompts☆110Updated 2 years ago
- An Extension for oobabooga/text-generation-webui☆36Updated 2 years ago
- 4 bits quantization of SantaCoder using GPTQ☆51Updated 2 years ago
- A guidance language for controlling large language models.☆45Updated 2 years ago
- A free AI text generation interface based on KoboldAI☆34Updated last year
- Harnessing the Memory Power of the Camelids☆146Updated last year
- Creates an Langchain Agent which uses the WebUI's API and Wikipedia to work☆74Updated last year
- A Qt GUI for large language models☆44Updated last year
- A prompt/context management system☆170Updated 2 years ago
- An autonomous AI agent extension for Oobabooga's web ui☆176Updated last year
- Little AI roleplay program☆59Updated last year
- Model REVOLVER, a human in the loop model mixing system.☆33Updated 2 years ago
- Train Llama Loras Easily☆31Updated 2 years ago
- BabyAGI to run with locally hosted models using the API from https://github.com/oobabooga/text-generation-webui☆88Updated 2 years ago
- Just a simple HowTo for https://github.com/johnsmith0031/alpaca_lora_4bit☆32Updated 2 years ago
- ☆74Updated last year
- Experimental LLM Inference UX to aid in creative writing☆119Updated 7 months ago
- An Autonomous LLM Agent that runs on Wizcoder-15B☆334Updated 9 months ago
- A fast batching API to serve LLM models☆185Updated last year
- Text WebUI extension to add clever Notebooks to Chat mode☆142Updated this week
- SLOP Detector and analyzer based on dictionary for shareGPT JSON and text☆72Updated 9 months ago
- After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around…☆54Updated 11 months ago
- Let's create synthetic textbooks together :)☆75Updated last year
- A KoboldAI-like memory extension for oobabooga's text-generation-webui☆108Updated 9 months ago
- Experimental sampler to make LLMs more creative☆31Updated 2 years ago
- ☆24Updated last year
- Deploy your GGML models to HuggingFace Spaces with Docker and gradio☆37Updated 2 years ago
- Oobabooga extension for Bark TTS☆119Updated last year