flowritecom / flow-merge
flow-merge is a powerful Python library that enables seamless merging of multiple transformer-based language models using the most popular merge methods such as model soups, SLERP, ties-MERGING or DARE.
☆17Updated last month
Alternatives and similar repositories for flow-merge:
Users that are interested in flow-merge are comparing it to the libraries listed below
- Unofficial Implementation of Evolutionary Model Merging☆37Updated last year
- The Benefits of a Concise Chain of Thought on Problem Solving in Large Language Models☆21Updated 4 months ago
- A repository for research on medium sized language models.☆76Updated 10 months ago
- Repository for the Q-Filters method (https://arxiv.org/pdf/2503.02812)☆26Updated 3 weeks ago
- ☆48Updated 4 months ago
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆55Updated 7 months ago
- ☆21Updated 2 months ago
- The official code repo and data hub of top_nsigma sampling strategy for LLMs.☆24Updated last month
- ☆53Updated 10 months ago
- entropix style sampling + GUI☆25Updated 5 months ago
- Repo hosting codes and materials related to speeding LLMs' inference using token merging.☆35Updated 11 months ago
- Minimal implementation of the Self-Play Fine-Tuning Converts Weak Language Models to Strong Language Models paper (ArXiv 20232401.01335)☆29Updated last year
- Code Implementation, Evaluations, Documentation, Links and Resources for Min P paper☆28Updated 2 weeks ago
- LLM-Training-API: Including Embeddings & ReRankers, mergekit, LaserRMT☆27Updated last year
- https://x.com/BlinkDL_AI/status/1884768989743882276☆27Updated last month
- ☆32Updated 9 months ago
- Exploring Model Kinship for Merging Large Language Models☆23Updated last month
- ☆20Updated last year
- This repo is based on https://github.com/jiaweizzhao/GaLore☆26Updated 6 months ago
- Repository containing the SPIN experiments on the DIBT 10k ranked prompts☆24Updated last year
- QLoRA with Enhanced Multi GPU Support☆36Updated last year
- This is the official repository for Inheritune.☆111Updated last month
- Library to facilitate pruning of LLMs based on context☆32Updated last year
- Spherical Merge Pytorch/HF format Language Models with minimal feature loss.☆117Updated last year
- ☆16Updated 2 months ago
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆33Updated last year
- Small and Efficient Mathematical Reasoning LLMs☆71Updated last year
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡☆67Updated 4 months ago
- Plug in & Play Pytorch Implementation of the paper: "Evolutionary Optimization of Model Merging Recipes" by Sakana AI☆30Updated 4 months ago
- ☆47Updated 7 months ago