Alternatives and similar repositories for evolutionary-model-merge:

Users that are interested in evolutionary-model-merge are comparing it to the libraries listed below

• jiaweizzhao / GaLore
  GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection
  ☆1,501Updated 3 months ago
• uclaml / SPIN
  The official implementation of Self-Play Fine-Tuning (SPIN)
  ☆1,118Updated 9 months ago
• lucidrains / self-rewarding-lm-pytorch
  Implementation of the training framework proposed in Self-Rewarding Language Model, from MetaAI
  ☆1,361Updated 10 months ago
• myshell-ai / JetMoE
  Reaching LLaMA2 Performance with 0.1M Dollars
  ☆973Updated 6 months ago
• ezelikman / quiet-star
  Code for Quiet-STaR
  ☆713Updated 6 months ago
• microsoft / Samba
  Official implementation of "Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling"
  ☆841Updated this week
• kyegomez / BitNet
  Implementation of "BitNet: Scaling 1-bit Transformers for Large Language Models" in pytorch
  ☆1,760Updated 3 weeks ago
• AnswerDotAI / fsdp_qlora
  Training LLMs with QLoRA + FSDP
  ☆1,451Updated 3 months ago
• jzhang38 / EasyContext
  Memory optimization and training recipes to extrapolate language models' context length to 1 million tokens, with minimal hardware.
  ☆700Updated 4 months ago
• ContextualAI / HALOs
  A library with extensible implementations of DPO, KTO, PPO, ORPO, and other human-aware loss functions (HALOs).
  ☆804Updated last week
• hao-ai-lab / LookaheadDecoding
  [ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding
  ☆1,194Updated 4 months ago
• yule-BUAA / MergeLM
  Codebase for Merging Language Models (ICML 2024)
  ☆795Updated 9 months ago
• jquesnelle / yarn
  YaRN: Efficient Context Window Extension of Large Language Models
  ☆1,421Updated 10 months ago
• pytorch / torchtitan
  A PyTorch native library for large model training
  ☆3,326Updated this week
• microsoft / ToRA
  ToRA is a series of Tool-integrated Reasoning LLM Agents designed to solve challenging mathematical reasoning problems by interacting wit…
  ☆1,032Updated last year
• princeton-nlp / SimPO
  [NeurIPS 2024] SimPO: Simple Preference Optimization with a Reference-Free Reward
  ☆821Updated this week
• google-deepmind / funsearch
  ☆770Updated last year
• mistralai-sf24 / hackathon
  ☆446Updated 10 months ago
• huggingface / nanotron
  Minimalistic large language model 3D-parallelism training
  ☆1,483Updated this week
• princeton-nlp / MeZO
  [NeurIPS 2023] MeZO: Fine-Tuning Language Models with Just Forward Passes. https://arxiv.org/abs/2305.17333
  ☆1,083Updated last year
• arcee-ai / mergekit
  Tools for merging pretrained large language models.
  ☆5,273Updated last week
• NVlabs / DoRA
  [ICML2024 (Oral)] Official PyTorch implementation of DoRA: Weight-Decomposed Low-Rank Adaptation
  ☆717Updated 4 months ago
• huggingface / search-and-learn
  Recipes to scale inference-time compute of open models
  ☆1,002Updated last month
• trotsky1997 / MathBlackBox
  ☆1,006Updated 2 months ago
• HazyResearch / m2
  Repo for "Monarch Mixer: A Simple Sub-Quadratic GEMM-Based Architecture"
  ☆547Updated last month
• facebookresearch / memory
  Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…
  ☆297Updated 2 months ago
• princeton-nlp / LLM-Shearing
  [ICLR 2024] Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning
  ☆585Updated 11 months ago
• Beomi / BitNet-Transformers
  0️⃣1️⃣🤗 BitNet-Transformers: Huggingface Transformers Implementation of "BitNet: Scaling 1-bit Transformers for Large Language Models" i…
  ☆289Updated 11 months ago
• locuslab / wanda
  A simple and effective LLM pruning approach.
  ☆712Updated 6 months ago
• xfactlab / orpo
  Official repository for ORPO
  ☆437Updated 8 months ago