Spherical Merge Pytorch/HF format Language Models with minimal feature loss.
☆144Sep 10, 2023Updated 2 years ago
Alternatives and similar repositories for LLM-SLERP-Merge
Users that are interested in LLM-SLERP-Merge are comparing it to the libraries listed below
Sorting:
- Model REVOLVER, a human in the loop model mixing system.☆33Aug 2, 2023Updated 2 years ago
- ☆12Feb 11, 2026Updated 2 weeks ago
- Codebase for Merging Language Models (ICML 2024)☆863May 5, 2024Updated last year
- Merge Transformers language models by use of gradient parameters.☆214Aug 8, 2024Updated last year
- Low-Rank adapter extraction for fine-tuned transformers models☆180May 2, 2024Updated last year
- Image Diffusion block merging technique applied to transformers based Language Models.☆56May 8, 2023Updated 2 years ago
- ☆27Aug 30, 2023Updated 2 years ago
- Automated Identification of Redundant Layer Blocks for Pruning in Large Language Models☆261Apr 23, 2024Updated last year
- Using fourier interpolation to merge large language models☆11Jan 6, 2026Updated last month
- flow-merge is a powerful Python library that enables seamless merging of multiple transformer-based language models using the most popula…☆20Feb 12, 2025Updated last year
- A script for merging a LLM model and a LoRA☆13Jun 22, 2023Updated 2 years ago
- Code for PHATGOOSE introduced in "Learning to Route Among Specialized Experts for Zero-Shot Generalization"☆91Feb 27, 2024Updated 2 years ago
- Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model☆45Oct 1, 2025Updated 5 months ago
- ☆32Feb 8, 2024Updated 2 years ago
- ☆17Apr 11, 2024Updated last year
- This is the implementation of CounterCurate, the data curation pipeline of both physical and semantic counterfactual image-caption pairs.☆19Jun 27, 2024Updated last year
- ☆18Aug 19, 2024Updated last year
- Glyphs, acting as collaboratively defined symbols linking related concepts, add a layer of multidimensional semantic richness to user-AI …☆56Feb 10, 2025Updated last year
- This is our own implementation of 'Layer Selective Rank Reduction'☆240May 26, 2024Updated last year
- Official repository for the paper "SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention"☆102Sep 30, 2024Updated last year
- AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.☆99Oct 28, 2024Updated last year
- ☆274Oct 31, 2023Updated 2 years ago
- An unsupervised model merging algorithm for Transformers-based language models.☆108Apr 29, 2024Updated last year
- A repository to store helpful information and emerging insights in regard to LLMs☆21Oct 27, 2023Updated 2 years ago
- Official repository of Evolutionary Optimization of Model Merging Recipes☆1,399Nov 29, 2024Updated last year
- Simple LLM inference server☆20Jun 13, 2024Updated last year
- [ICLR 2024] Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning☆641Mar 4, 2024Updated last year
- A bagel, with everything.☆326Apr 11, 2024Updated last year
- Code repository for our EMNLP 2020 long paper "Modeling Protagonist Emotions for Emotion-Aware Storytelling" (https://arxiv.org/abs/2010.…☆20Feb 8, 2021Updated 5 years ago
- A flexible utility for converting tensor precision in PyTorch models and safetensors files, enabling efficient deployment across various …☆11Aug 24, 2023Updated 2 years ago
- Editing Models with Task Arithmetic☆534Jan 11, 2024Updated 2 years ago
- Code for paper: "QuIP: 2-Bit Quantization of Large Language Models With Guarantees"☆397Feb 24, 2024Updated 2 years ago
- Official repository for ORPO☆471May 31, 2024Updated last year
- Official implementation of "DoRA: Weight-Decomposed Low-Rank Adaptation"☆124Apr 28, 2024Updated last year
- ☆64Apr 9, 2024Updated last year
- ☆68Aug 16, 2024Updated last year
- Code for NeurIPS 2019 paper "Screening Sinkhorn Algorithm for Regularized Optimal Transport"☆10Feb 10, 2020Updated 6 years ago
- [ACM MM25] Official Pytorch implementation of [Decoupled Global-Local Alignment for Improving Compositional Understanding]☆15Jul 15, 2025Updated 7 months ago
- Make windows installer 🪟 for flutter powered apps💻.☆13Jul 6, 2024Updated last year