Alternatives and similar repositories for LLM-Merging

Users that are interested in LLM-Merging are comparing it to the libraries listed below

• prateeky2806 / ties-merging
  ☆196Updated last year
• ericwtodd / function_vectors
  Function Vectors in Large Language Models (ICLR 2024)
  ☆181Updated 6 months ago
• architsharma97 / dpo-rlaif
  ☆100Updated last year
• da03 / Internalize_CoT_Step_by_Step
  ☆195Updated 6 months ago
• lucidrains / CALM-pytorch
  Implementation of CALM from the paper "LLM Augmented LLMs: Expanding Capabilities through Composition", out of Google Deepmind
  ☆177Updated last year
• CASE-Lab-UMD / LLM-Drop
  The official implementation of the paper "What Matters in Transformers? Not All Attention is Needed".
  ☆179Updated 7 months ago
• QingruZhang / PASTA
  PASTA: Post-hoc Attention Steering for LLMs
  ☆126Updated 11 months ago
• roeehendel / icl_task_vectors
  ☆98Updated 2 years ago
• bminixhofer / zett
  Code for Zero-Shot Tokenizer Transfer
  ☆140Updated 9 months ago
• Mohammadjafari80 / GSM8K-RLVR
  A simplified implementation for experimenting with RLVR on GSM8K, This repository provides a starting point for exploring reasoning.
  ☆136Updated 8 months ago
• mlfoundations / scaling
  Language models scale reliably with over-training and on downstream tasks
  ☆100Updated last year
• shengliu66 / ICV
  Code for In-context Vectors: Making In Context Learning More Effective and Controllable Through Latent Space Steering
  ☆190Updated 8 months ago
• jonhue / activeft
  PyTorch library for Active Fine-Tuning
  ☆93Updated last month
• da03 / implicit_chain_of_thought
  ☆138Updated 11 months ago
• huggingface / datablations
  Scaling Data-Constrained Language Models
  ☆342Updated 4 months ago
• logix-project / logix
  AI Logging for Interpretability and Explainability🔬
  ☆130Updated last year
• allenai / olmes
  Reproducible, flexible LLM evaluations
  ☆260Updated this week
• OSU-NLP-Group / GrokkedTransformer
  Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'
  ☆232Updated 3 months ago
• ucl-dark / llm_debate
  Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"
  ☆118Updated last year
• google-deepmind / loft
  LOFT: A 1 Million+ Token Long-Context Benchmark
  ☆218Updated 4 months ago
• GFNOrg / gfn-lm-tuning
  ☆184Updated last year
• microsoft / rho
  Repo for Rho-1: Token-level Data Selection & Selective Pretraining of LLMs.
  ☆441Updated last year
• stanfordnlp / axbench
  Stanford NLP Python library for benchmarking the utility of LLM interpretability methods
  ☆136Updated 4 months ago
• locuslab / massive-activations
  Code accompanying the paper "Massive Activations in Large Language Models"
  ☆184Updated last year
• Cohere-Labs-Community / parameter-efficient-moe
  ☆271Updated 2 years ago
• ahans30 / goldfish-loss
  [NeurIPS 2024] Goldfish Loss: Mitigating Memorization in Generative LLMs
  ☆92Updated 11 months ago
• yihedeng9 / rlhf-summary-notes
  A brief and partial summary of RLHF algorithms.
  ☆133Updated 7 months ago
• kyegomez / Lets-Verify-Step-by-Step
  "Improving Mathematical Reasoning with Process Supervision" by OPENAI
  ☆111Updated last week
• google-deepmind / natural-plan
  ☆51Updated last year
• dmis-lab / Monet
  [ICLR 2025] Monet: Mixture of Monosemantic Experts for Transformers
  ☆73Updated 4 months ago