kyegomez / EvoVLM-JPLinks
Plug in & Play Pytorch Implementation of the paper: "Evolutionary Optimization of Model Merging Recipes" by Sakana AI
☆31Updated 9 months ago
Alternatives and similar repositories for EvoVLM-JP
Users that are interested in EvoVLM-JP are comparing it to the libraries listed below
Sorting:
- Unofficial Implementation of Evolutionary Model Merging☆39Updated last year
- Official repository for the paper "SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention"☆98Updated 11 months ago
- ☆85Updated last year
- ☆202Updated 8 months ago
- ☆72Updated last year
- The official implementation of Self-Exploring Language Models (SELM)☆64Updated last year
- A repository for research on medium sized language models.☆78Updated last year
- Pytorch implementation of the PEER block from the paper, Mixture of A Million Experts, by Xu Owen He at Deepmind☆127Updated last year
- ☆121Updated 6 months ago
- ☆69Updated last year
- EvaByte: Efficient Byte-level Language Models at Scale☆109Updated 4 months ago
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks (EMNLP'24)☆147Updated 11 months ago
- Token Omission Via Attention☆128Updated 10 months ago
- ☆46Updated last year
- This is the official repository for the paper "Flora: Low-Rank Adapters Are Secretly Gradient Compressors" in ICML 2024.☆104Updated last year
- ☆34Updated 7 months ago
- OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.☆173Updated 7 months ago
- Implementation of 🥥 Coconut, Chain of Continuous Thought, in Pytorch☆179Updated 2 months ago
- ☆100Updated last year
- Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters☆129Updated 8 months ago
- ☆102Updated 11 months ago
- The evaluation framework for training-free sparse attention in LLMs☆91Updated 2 months ago
- Implementation of CALM from the paper "LLM Augmented LLMs: Expanding Capabilities through Composition", out of Google Deepmind☆177Updated 11 months ago
- [NeurIPS 2024] Low rank memory efficient optimizer without SVD☆30Updated 2 months ago
- Challenge LLMs to Reason About Reasoning: A Benchmark to Unveil Cognitive Depth in LLMs☆50Updated last year
- Repository for the Q-Filters method (https://arxiv.org/pdf/2503.02812)☆34Updated 5 months ago
- Collection of autoregressive model implementation☆86Updated 4 months ago
- RWKV-7: Surpassing GPT☆94Updated 9 months ago
- ☆26Updated 7 months ago
- The official repo for "LLoCo: Learning Long Contexts Offline"☆118Updated last year