arcee-ai / mergekit
Tools for merging pretrained large language models.
☆4,501Updated this week
Related projects: ⓘ
- SGLang is a fast serving framework for large language models and vision language models.☆5,121Updated this week
- Robust recipes to align language models with human and AI preferences☆4,481Updated 3 weeks ago
- A Native-PyTorch Library for LLM Fine-tuning☆3,942Updated this week
- A framework for few-shot evaluation of language models.☆6,426Updated this week
- Go ahead and axolotl questions☆7,554Updated this week
- To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x com…☆4,435Updated 3 weeks ago
- A fast inference library for running LLMs locally on modern consumer-class GPUs☆3,484Updated this week
- An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.