ThomasBaruzier / llama.cpp-helper
Makes llama.cpp easy to use.
☆12Updated last year
Related projects ⓘ
Alternatives and complementary repositories for llama.cpp-helper
- Experimental sampler to make LLMs more creative☆30Updated last year
- A simple experiment on letting two local LLM have a conversation about anything!☆92Updated 4 months ago
- Creates an Langchain Agent which uses the WebUI's API and Wikipedia to work☆73Updated last year
- GPT-2 small trained on phi-like data☆65Updated 9 months ago
- Like system requirements lab but for LLMs☆30Updated last year
- The hearth of The Pulsar App, fast, secure and shared inference with modern UI☆35Updated 3 weeks ago
- Accepts a Hugging Face model URL, automatically downloads and quantizes it using Bits and Bytes.☆38Updated 8 months ago
- A Qt GUI for large language models☆40Updated last year
- oobabooga extension - Experimental sampler to make LLMs more creative☆23Updated last year
- ☆72Updated last year
- ☆30Updated 6 months ago
- idea: https://github.com/nyxkrage/ebook-groupchat/☆82Updated 3 months ago
- Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA☆124Updated last year
- Let's create synthetic textbooks together :)☆70Updated 9 months ago
- Easily create LLM automation/agent workflows☆55Updated 9 months ago
- run ollama & gguf easily with a single command☆48Updated 6 months ago
- BUD-E (Buddy) is an open-source voice assistant framework that facilitates seamless interaction with AI models and APIs, enabling the cre…☆28Updated 4 months ago
- An Extension for oobabooga/text-generation-webui☆36Updated last year
- ☆18Updated last month
- ☆24Updated 5 months ago
- Just a simple HowTo for https://github.com/johnsmith0031/alpaca_lora_4bit☆31Updated last year
- AnyModal is a Flexible Multimodal Language Model Framework for PyTorch☆49Updated this week
- No-messing-around sh client for llama.cpp's server☆27Updated 3 months ago
- Low-Rank adapter extraction for fine-tuned transformers model☆162Updated 6 months ago
- Implements harmful/harmless refusal removal using pure HF Transformers☆25Updated 5 months ago
- Simple and fast server for GPTQ-quantized LLaMA inference☆24Updated last year
- High level tool use for LLMs☆34Updated 3 months ago
- ☆25Updated last month
- SLOP Detector and analyzer based on dictionary for shareGPT JSON and text☆45Updated 3 weeks ago