KerfuffleV2 / gguf-tools
Some random tools for working with the GGUF file format
☆20Updated 11 months ago
Related projects ⓘ
Alternatives and complementary repositories for gguf-tools
- run ollama & gguf easily with a single command☆48Updated 6 months ago
- GGUF parser in Python☆21Updated 3 months ago
- automatically quant GGUF models☆140Updated this week
- Model REVOLVER, a human in the loop model mixing system.☆33Updated last year
- entropix style sampling + GUI☆25Updated 3 weeks ago
- Easily view and modify JSON datasets for large language models☆62Updated last month
- After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around…☆56Updated 3 months ago
- An unsupervised model merging algorithm for Transformers-based language models.☆100Updated 6 months ago
- Experimental sampler to make LLMs more creative☆30Updated last year
- GPT-2 small trained on phi-like data☆65Updated 9 months ago
- A pipeline parallel training script for LLMs.☆83Updated this week
- The hearth of The Pulsar App, fast, secure and shared inference with modern UI☆35Updated 3 weeks ago
- Low-Rank adapter extraction for fine-tuned transformers model☆162Updated 6 months ago
- win32 native frontend for llama-cli☆12Updated 2 weeks ago
- LLM backed Fantasy Tribe Game☆18Updated 2 weeks ago
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆113Updated 3 weeks ago
- 5X faster 60% less memory QLoRA finetuning☆21Updated 5 months ago
- QuIP quantization☆46Updated 8 months ago
- ☆27Updated last year
- ☆49Updated 8 months ago
- ☆104Updated 8 months ago
- idea: https://github.com/nyxkrage/ebook-groupchat/☆82Updated 3 months ago
- Simple extension for text-generation-webui that injects recent conversation history into the negative prompt with the goal of minimizing …☆33Updated last year
- ☆15Updated 5 months ago
- ☆53Updated 5 months ago
- Accepts a Hugging Face model URL, automatically downloads and quantizes it using Bits and Bytes.☆38Updated 8 months ago
- ☆25Updated 2 months ago
- Mistral7B playing DOOM☆27Updated 7 months ago
- Prompt Jinja2 templates for LLMs☆27Updated 2 months ago