llm-merging / LLM-MergingLinks
LLM-Merging: Building LLMs Efficiently through Merging
☆199Updated 9 months ago
Alternatives and similar repositories for LLM-Merging
Users that are interested in LLM-Merging are comparing it to the libraries listed below
Sorting:
- ☆183Updated last year
- ☆97Updated 11 months ago
- Function Vectors in Large Language Models (ICLR 2024)☆170Updated 2 months ago
- Code for Zero-Shot Tokenizer Transfer☆131Updated 5 months ago
- ☆95Updated last year
- ☆180Updated 2 months ago
- ☆123Updated 8 months ago
- Implementation of 🥥 Coconut, Chain of Continuous Thought, in Pytorch☆175Updated this week
- PyTorch library for Active Fine-Tuning☆80Updated 4 months ago
- Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".☆205Updated 2 weeks ago
- AI Logging for Interpretability and Explainability🔬☆123Updated last year
- open-source code for paper: Retrieval Head Mechanistically Explains Long-Context Factuality☆200Updated 10 months ago
- [ICLR 2025] Monet: Mixture of Monosemantic Experts for Transformers☆69Updated this week
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆75Updated 10 months ago
- Code and example data for the paper: Rule Based Rewards for Language Model Safety☆188Updated 11 months ago
- Repo for Rho-1: Token-level Data Selection & Selective Pretraining of LLMs.☆421Updated last year
- ☆180Updated last year
- The HELMET Benchmark☆154Updated 2 months ago
- The official implementation of the paper "What Matters in Transformers? Not All Attention is Needed".☆173Updated 2 months ago
- Code for the paper "VinePPO: Unlocking RL Potential For LLM Reasoning Through Refined Credit Assignment"☆161Updated last month
- ☆190Updated 2 months ago
- Steering vectors for transformer language models in Pytorch / Huggingface☆108Updated 4 months ago
- Language models scale reliably with over-training and on downstream tasks☆97Updated last year
- ☆132Updated 7 months ago
- Code accompanying the paper "Massive Activations in Large Language Models"☆163Updated last year
- Reproducible, flexible LLM evaluations☆214Updated last month
- A brief and partial summary of RLHF algorithms.☆129Updated 3 months ago
- Implementation of CALM from the paper "LLM Augmented LLMs: Expanding Capabilities through Composition", out of Google Deepmind☆177Updated 9 months ago
- ☆131Updated 7 months ago
- ☆74Updated last year