fangyuan-ksgk / Evolutionary-Model-Merge
Unofficial Implementation of Evolutionary Model Merging
☆33Updated 10 months ago
Alternatives and similar repositories for Evolutionary-Model-Merge:
Users that are interested in Evolutionary-Model-Merge are comparing it to the libraries listed below
- Plug in & Play Pytorch Implementation of the paper: "Evolutionary Optimization of Model Merging Recipes" by Sakana AI☆28Updated 3 months ago
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks☆140Updated 4 months ago
- The official implementation of Self-Exploring Language Models (SELM)☆61Updated 8 months ago
- Spherical Merge Pytorch/HF format Language Models with minimal feature loss.☆115Updated last year
- A repository for research on medium sized language models.☆76Updated 8 months ago
- ☆74Updated last month
- This is the official repository for Inheritune.☆109Updated this week
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆54Updated 5 months ago
- Official repository for the paper "SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention"