matt-c1 / llama-3-quant-comparison
Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.
☆113Updated 4 months ago
Related projects: ⓘ
- A fast batching API to serve LLM models☆172Updated 4 months ago
- Low-Rank adapter extraction for fine-tuned transformers model☆154Updated 4 months ago
- This is our own implementation of 'Layer Selective Rank Reduction'☆229Updated 3 months ago
- ☆144Updated 2 months ago
- Web UI for ExLlamaV2☆420Updated 2 weeks ago
- A multimodal, function calling powered LLM webui.☆204Updated 3 months ago
- 1.58-bit LLaMa model☆77Updated 5 months ago
- Simple Python library/structure to ablate features in LLMs which are supported by TransformerLens☆288Updated 3 months ago
- Dataset Crafting w/ RAG/Wikipedia ground truth and Efficient Fine-Tuning Using MLX and Unsloth. Includes configurable dataset annotation …☆155Updated last month
- Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI☆223Updated 4 months ago
- A python application that routes incoming prompts to an LLM by category, and can support a single incoming connection from a front end to…☆133Updated this week
- Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA☆123Updated last year
- Dolphin System Messages☆185Updated this week
- Automated Identification of Redundant Layer Blocks for Pruning in Large Language Models☆177Updated 4 months ago
- Easily view and modify JSON datasets for large language models☆55Updated this week
- An OAI compatible exllamav2 API that's both lightweight and fast☆455Updated this week
- 🚀 Retrieval Augmented Generation (RAG) with txtai. Combine search and LLMs to find insights with your own data.☆226Updated 2 weeks ago
- Experimental LLM Inference UX to aid in creative writing☆81Updated 2 months ago
- LLM Frontend in a single html file☆221Updated last week
- A collection of prompts to challenge the reasoning abilities of large language models in presence of misguiding information☆51Updated this week
- Memoir+ a persona extension for Text Gen Web UI. That includes memory, emotions, command handling and more.☆164Updated last month
- Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.☆158Updated 2 months ago
- A frontend for creative writing with LLMs☆102Updated 2 months ago
- Open source LLM UI, compatible with all local LLM providers.☆163Updated last week
- An unsupervised model merging algorithm for Transformers-based language models.☆96Updated 4 months ago
- idea: https://github.com/nyxkrage/ebook-groupchat/☆77Updated last month
- Merge Transformers language models by use of gradient parameters.☆193Updated last month
- A community list of common phrases generated by GPT and Claude models☆68Updated 10 months ago
- A library for easily merging multiple LLM experts, and efficiently train the merged LLM.☆388Updated 3 weeks ago
- Chat with your current directory's files using a local or API LLM.☆169Updated 3 weeks ago