flowritecom / flow-mergeLinks
flow-merge is a powerful Python library that enables seamless merging of multiple transformer-based language models using the most popular merge methods such as model soups, SLERP, ties-MERGING or DARE.
☆20Updated 8 months ago
Alternatives and similar repositories for flow-merge
Users that are interested in flow-merge are comparing it to the libraries listed below
Sorting:
- entropix style sampling + GUI☆27Updated 11 months ago
- Unofficial Implementation of Evolutionary Model Merging☆39Updated last year
- ☆55Updated 11 months ago
- The Benefits of a Concise Chain of Thought on Problem Solving in Large Language Models☆22Updated 10 months ago
- ☆51Updated last year
- ☆14Updated 3 months ago
- Easy to use, High Performant Knowledge Distillation for LLMs☆93Updated 5 months ago
- ☆119Updated last year
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆60Updated last year
- A repository for research on medium sized language models.☆78Updated last year
- ☆36Updated 2 months ago
- https://x.com/BlinkDL_AI/status/1884768989743882276☆28Updated 5 months ago
- ☆80Updated 11 months ago
- 5X faster 60% less memory QLoRA finetuning☆21Updated last year
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡☆67Updated 11 months ago
- ☆22Updated 2 months ago
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks☆31Updated last year
- Lightweight continuous batching OpenAI compatibility using HuggingFace Transformers include T5 and Whisper.☆29Updated 7 months ago
- An unofficial pytorch implementation of 'Efficient Infinite Context Transformers with Infini-attention'☆53Updated last year
- ☆136Updated last year
- ☆90Updated 11 months ago
- This is the official repository for Inheritune.☆115Updated 8 months ago
- The simplest, fastest repository for training/finetuning medium-sized xLSTMs.☆41Updated last year
- Lego for GRPO☆30Updated 4 months ago
- Load multiple LoRA modules simultaneously and automatically switch the appropriate combination of LoRA modules to generate the best answe…☆158Updated last year
- LLM-Training-API: Including Embeddings & ReRankers, mergekit, LaserRMT☆27Updated last year
- ☆27Updated 4 months ago
- An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO☆29Updated last week
- ☆25Updated 9 months ago
- The official code repo and data hub of top_nsigma sampling strategy for LLMs.☆26Updated 8 months ago