Alternatives and similar repositories for mergoo

Users that are interested in mergoo are comparing it to the libraries listed below

• xfactlab / orpo
  Official repository for ORPO
  ☆455Updated last year
• huggingface / cosmopedia
  ☆520Updated 7 months ago
• cognitivecomputations / laserRMT
  This is our own implementation of 'Layer Selective Rank Reduction'
  ☆239Updated last year
• arcee-ai / PruneMe
  Automated Identification of Redundant Layer Blocks for Pruning in Large Language Models
  ☆238Updated last year
• tianyi-lab / Reflection_Tuning
  [ACL'24] Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning
  ☆357Updated 9 months ago
• jondurbin / bagel
  A bagel, with everything.
  ☆321Updated last year
• pratyushasharma / laser
  The Truth Is In There: Improving Reasoning in Language Models with Layer-Selective Rank Reduction
  ☆388Updated 11 months ago
• arcee-ai / EvolKit
  EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…
  ☆223Updated 7 months ago
• datamllab / LongLM
  [ICML'24 Spotlight] LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning
  ☆653Updated last year
• magpie-align / magpie
  [ICLR 2025] Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing. Your efficient and high-quality synthetic data …
  ☆713Updated 3 months ago
• arcee-ai / DistillKit
  An Open Source Toolkit For LLM Distillation
  ☆651Updated 3 weeks ago
• jzhang38 / EasyContext
  Memory optimization and training recipes to extrapolate language models' context length to 1 million tokens, with minimal hardware.
  ☆731Updated 8 months ago
• Pints-AI / 1.5-Pints
  A compact LLM pretrained in 9 days by using high quality data
  ☆314Updated 2 months ago
• thomasgauthier / LoRD
  Low-Rank adapter extraction for fine-tuned transformers models
  ☆173Updated last year
• fanqiwan / FuseAI
  FuseAI Project
  ☆573Updated 4 months ago
• EricLBuehler / xlora
  X-LoRA: Mixture of LoRA Experts
  ☆229Updated 10 months ago
• VITA-Group / Q-GaLore
  Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.
  ☆198Updated 11 months ago
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆282Updated 7 months ago
• yule-BUAA / MergeLM
  Codebase for Merging Language Models (ICML 2024)
  ☆832Updated last year
• Digitous / LLM-SLERP-Merge
  Spherical Merge Pytorch/HF format Language Models with minimal feature loss.
  ☆129Updated last year
• neelsjain / NEFTune
  Official repository of NEFTune: Noisy Embeddings Improves Instruction Finetuning
  ☆396Updated last year
• uukuguy / multi_loras
  Load multiple LoRA modules simultaneously and automatically switch the appropriate combination of LoRA modules to generate the best answe…
  ☆154Updated last year
• JinjieNi / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆242Updated 7 months ago
• WildEval / ZeroEval
  A simple unified framework for evaluating LLMs
  ☆217Updated 2 months ago
• ezelikman / quiet-star
  Code for Quiet-STaR
  ☆734Updated 10 months ago
• FranxYao / Long-Context-Data-Engineering
  Implementation of paper Data Engineering for Scaling Language Models to 128K Context
  ☆463Updated last year
• ContextualAI / gritlm
  Generative Representational Instruction Tuning
  ☆651Updated 3 months ago
• Mihaiii / llm_steer
  Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…
  ☆239Updated 4 months ago
• mlfoundations / evalchemy
  Automatic evals for LLMs
  ☆429Updated 2 weeks ago
• allenai / reward-bench
  RewardBench: the first evaluation tool for reward models.
  ☆604Updated last week