Alternatives and similar repositories for mergoo

Users that are interested in mergoo are comparing it to the libraries listed below

• arcee-ai / DistillKit
  An Open Source Toolkit For LLM Distillation
  ☆612Updated last month
• datamllab / LongLM
  [ICML'24 Spotlight] LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning
  ☆651Updated last year
• huggingface / cosmopedia
  ☆517Updated 6 months ago
• tianyi-lab / Reflection_Tuning
  [ACL'24] Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning
  ☆353Updated 8 months ago
• arcee-ai / PruneMe
  Automated Identification of Redundant Layer Blocks for Pruning in Large Language Models
  ☆236Updated last year
• jzhang38 / EasyContext
  Memory optimization and training recipes to extrapolate language models' context length to 1 million tokens, with minimal hardware.
  ☆725Updated 8 months ago
• arcee-ai / EvolKit
  EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…
  ☆220Updated 7 months ago
• xfactlab / orpo
  Official repository for ORPO
  ☆453Updated last year
• ContextualAI / gritlm
  Generative Representational Instruction Tuning
  ☆639Updated 2 months ago
• magpie-align / magpie
  [ICLR 2025] Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing. Your efficient and high-quality synthetic data …
  ☆705Updated 2 months ago
• princeton-nlp / LLM-Shearing
  [ICLR 2024] Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning
  ☆611Updated last year
• fanqiwan / FuseAI
  FuseAI Project
  ☆569Updated 4 months ago
• jondurbin / bagel
  A bagel, with everything.
  ☆320Updated last year
• mlabonne / llm-autoeval
  Automatically evaluate your LLMs in Google Colab
  ☆629Updated last year
• Pints-AI / 1.5-Pints
  A compact LLM pretrained in 9 days by using high quality data
  ☆312Updated last month
• Mihaiii / llm_steer
  Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…
  ☆238Updated 3 months ago
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆281Updated 7 months ago
• prometheus-eval / prometheus-eval
  Evaluate your LLM's response with Prometheus and GPT4 💯
  ☆948Updated last month
• mlfoundations / evalchemy
  Automatic evals for LLMs
  ☆399Updated this week
• JinjieNi / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆241Updated 6 months ago
• cognitivecomputations / laserRMT
  This is our own implementation of 'Layer Selective Rank Reduction'
  ☆238Updated last year
• yule-BUAA / MergeLM
  Codebase for Merging Language Models (ICML 2024)
  ☆824Updated last year
• pratyushasharma / laser
  The Truth Is In There: Improving Reasoning in Language Models with Layer-Selective Rank Reduction
  ☆386Updated 10 months ago
• thomasgauthier / LoRD
  Low-Rank adapter extraction for fine-tuned transformers models
  ☆171Updated last year
• uukuguy / multi_loras
  Load multiple LoRA modules simultaneously and automatically switch the appropriate combination of LoRA modules to generate the best answe…
  ☆151Updated last year
• lm-sys / llm-decontaminator
  Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"
  ☆302Updated last year
• ezelikman / quiet-star
  Code for Quiet-STaR
  ☆732Updated 9 months ago
• sail-sg / lorahub
  [COLM 2024] LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Composition
  ☆635Updated 10 months ago
• VITA-Group / Q-GaLore
  Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.
  ☆199Updated 10 months ago
• facebookresearch / LayerSkip
  Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", ACL 2024
  ☆301Updated 3 weeks ago