brittlewis12 / autoggufLinks
Easily convert HuggingFace models to GGUF-format for llama.cpp
☆23Updated last year
Alternatives and similar repositories for autogguf
Users that are interested in autogguf are comparing it to the libraries listed below
Sorting:
- An unsupervised model merging algorithm for Transformers-based language models.☆106Updated last year
- Let's create synthetic textbooks together :)☆75Updated last year
- Experimental sampler to make LLMs more creative☆31Updated 2 years ago
- ☆51Updated last year
- Easy to use, High Performant Knowledge Distillation for LLMs☆93Updated 5 months ago
- Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.☆42Updated last month
- Lightweight continuous batching OpenAI compatibility using HuggingFace Transformers include T5 and Whisper.☆29Updated 6 months ago
- 🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform☆38Updated last year
- ☆115Updated 9 months ago
- Accepts a Hugging Face model URL, automatically downloads and quantizes it using Bits and Bytes.☆38Updated last year
- A pipeline parallel training script for LLMs.☆157Updated 5 months ago
- The hearth of The Pulsar App, fast, secure and shared inference with modern UI☆57Updated 10 months ago
- Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…☆42Updated last year
- run ollama & gguf easily with a single command☆52Updated last year
- B-Llama3o a llama3 with Vision Audio and Audio understanding as well as text and Audio and Animation Data output.☆26Updated last year
- AnyModal is a Flexible Multimodal Language Model Framework for PyTorch☆103Updated 9 months ago
- BUD-E (Buddy) is an open-source voice assistant framework that facilitates seamless interaction with AI models and APIs, enabling the cre…☆40Updated last year
- GPT-4 Level Conversational QA Trained In a Few Hours☆65Updated last year
- automatically quant GGUF models☆210Updated last week
- Scripts to create your own moe models using mlx☆90Updated last year
- ☆26Updated 2 years ago
- The Benefits of a Concise Chain of Thought on Problem Solving in Large Language Models☆22Updated 10 months ago
- Low-Rank adapter extraction for fine-tuned transformers models☆178Updated last year
- ☆67Updated last year
- entropix style sampling + GUI☆27Updated 11 months ago
- An OpenAI API compatible LLM inference server based on ExLlamaV2.☆25Updated last year
- BUD-E (Buddy) is an open-source voice assistant framework that facilitates seamless interaction with AI models and APIs, enabling the cre…☆22Updated last year
- After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around…☆53Updated last year
- 5X faster 60% less memory QLoRA finetuning☆21Updated last year
- LLM-Training-API: Including Embeddings & ReRankers, mergekit, LaserRMT☆27Updated last year