ThomasBaruzier / llama.cpp-helperLinks
Makes llama.cpp easy to use.
☆12Updated 3 weeks ago
Alternatives and similar repositories for llama.cpp-helper
Users that are interested in llama.cpp-helper are comparing it to the libraries listed below
Sorting:
- Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA☆123Updated last year
- ☆114Updated 5 months ago
- A Qt GUI for large language models☆43Updated last year
- ☆73Updated last year
- Experimental LLM Inference UX to aid in creative writing☆114Updated 5 months ago
- Experimental sampler to make LLMs more creative☆31Updated last year
- A simple experiment on letting two local LLM have a conversation about anything!☆110Updated 11 months ago
- Creates an Langchain Agent which uses the WebUI's API and Wikipedia to work☆74Updated last year
- Little AI roleplay program☆58Updated last year
- ☆24Updated 4 months ago
- Low-Rank adapter extraction for fine-tuned transformers models☆171Updated last year
- SLOP Detector and analyzer based on dictionary for shareGPT JSON and text☆70Updated 7 months ago
- BUD-E (Buddy) is an open-source voice assistant framework that facilitates seamless interaction with AI models and APIs, enabling the cre…☆34Updated 10 months ago
- Serving LLMs in the HF-Transformers format via a PyFlask API☆71Updated 8 months ago
- run ollama & gguf easily with a single command☆50Updated last year
- Just a simple HowTo for https://github.com/johnsmith0031/alpaca_lora_4bit☆31Updated 2 years ago
- A simple speech-to-text and text-to-speech AI chatbot that can be run fully offline.☆45Updated last year
- An OpenAI API compatible LLM inference server based on ExLlamaV2.☆25Updated last year
- Gradio based tool to run opensource LLM models directly from Huggingface☆91Updated 11 months ago
- Let's create synthetic textbooks together :)☆75Updated last year
- 4 bits quantization of SantaCoder using GPTQ☆50Updated 2 years ago
- After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around…☆54Updated 9 months ago
- annoy long term memory experiment for oobabooga/text-generation-webui☆31Updated last year
- Like system requirements lab but for LLMs☆31Updated last year
- Python package wrapping llama.cpp for on-device LLM inference☆63Updated this week
- A frontend for creative writing with LLMs☆122Updated 10 months ago
- An Extension for oobabooga/text-generation-webui☆36Updated last year
- The simplest, fastest repository for training/finetuning medium-sized xLSTMs.☆41Updated last year
- Accepts a Hugging Face model URL, automatically downloads and quantizes it using Bits and Bytes.☆38Updated last year
- ☆129Updated last month