kyegomez / EvoVLM-JP
Plug in & Play Pytorch Implementation of the paper: "Evolutionary Optimization of Model Merging Recipes" by Sakana AI
☆28Updated 3 months ago
Alternatives and similar repositories for EvoVLM-JP:
Users that are interested in EvoVLM-JP are comparing it to the libraries listed below
- Unofficial Implementation of Evolutionary Model Merging☆33Updated 10 months ago
- The official implementation of Self-Exploring Language Models (SELM)☆61Updated 8 months ago
- This repo is based on https://github.com/jiaweizzhao/GaLore☆24Updated 4 months ago
- ☆58Updated 9 months ago
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks☆140Updated 4 months ago
- Official repository for the paper "SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention"☆96Updated 4 months ago
- A repository for research on medium sized language models.☆76Updated 8 months ago
- ☆90Updated 3 weeks ago
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆54Updated 5 months ago
- ☆106Updated 3 weeks ago
- ☆71Updated 5 months ago
- ☆26Updated last month
- ☆95Updated 7 months ago
- Language models scale reliably with over-training and on downstream tasks☆96Updated 10 months ago
- ☆146Updated last week
- My fork os allen AI's OLMo for educational purposes.☆30Updated 2 months ago
- ☆62Updated 4 months ago
- ☆74Updated last month
- ☆82Updated 4 months ago
- Implementation of the Quiet-STAR paper (https://arxiv.org/pdf/2403.09629.pdf)☆51Updated 6 months ago
- Minimal implementation of the Self-Play Fine-Tuning Converts Weak Language Models to Strong Language Models paper (ArXiv 20232401.01335)☆29Updated 11 months ago
- From GaLore to WeLore: How Low-Rank Weights Non-uniformly Emerge from Low-Rank Gradients. Ajay Jaiswal, Lu Yin, Zhenyu Zhang, Shiwei Liu,…☆42Updated 6 months ago
- Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"☆46Updated last year
- Implementation of 🥥 Coconut, Chain of Continuous Thought, in Pytorch☆152Updated last month
- ☆66Updated 7 months ago
- ☆14Updated 10 months ago
- ☆31Updated 7 months ago