KerfuffleV2 / gguf-tools
Some random tools for working with the GGUF file format
☆24Updated last year
Alternatives and similar repositories for gguf-tools:
Users that are interested in gguf-tools are comparing it to the libraries listed below
- run ollama & gguf easily with a single command☆49Updated 8 months ago
- automatically quant GGUF models☆151Updated this week
- Text generation in Python, as easy as possible☆48Updated last week
- Experimental sampler to make LLMs more creative☆30Updated last year
- After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around…☆56Updated 5 months ago
- ☆108Updated last month
- entropix style sampling + GUI☆25Updated 2 months ago
- ☆26Updated 3 months ago
- idea: https://github.com/nyxkrage/ebook-groupchat/☆84Updated 5 months ago
- Easily view and modify JSON datasets for large language models☆68Updated 3 months ago
- This repo provides a simple Gradio UI to run Qwen2 VL 72B AWQ in venv and have both image and video inferencing work.☆26Updated 3 months ago
- An Extension for oobabooga/text-generation-webui☆36Updated last year
- An unsupervised model merging algorithm for Transformers-based language models.☆101Updated 8 months ago
- Create text chunks which end at natural stopping points without using a tokenizer☆26Updated last month
- ☆65Updated 7 months ago
- ☆30Updated 8 months ago
- SLOP Detector and analyzer based on dictionary for shareGPT JSON and text☆49Updated 2 months ago
- Easily convert HuggingFace models to GGUF-format for llama.cpp☆21Updated 5 months ago
- ☆21Updated 4 months ago
- ☆27Updated last year
- Model REVOLVER, a human in the loop model mixing system.☆33Updated last year
- Prompt Jinja2 templates for LLMs☆28Updated 3 weeks ago
- A Qt GUI for large language models☆40Updated last year
- ☆31Updated last year
- 1.58-bit LLaMa model☆80Updated 9 months ago
- 5X faster 60% less memory QLoRA finetuning☆21Updated 7 months ago
- "a towel is about the most massively useful thing an interstellar AI hitchhiker can have"☆48Updated 3 months ago
- Accepts a Hugging Face model URL, automatically downloads and quantizes it using Bits and Bytes.☆38Updated 10 months ago
- LLM backed Fantasy Tribe Game☆18Updated 2 months ago