Alternatives and similar repositories for MergeBench

Users that are interested in MergeBench are comparing it to the libraries listed below

• r-three / RAD
  Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model
  ☆44Updated last year
• GSYfate / knnlm-limits
  Official code repo for paper "Great Memory, Shallow Reasoning: Limits of kNN-LMs"
  ☆23Updated 4 months ago
• sfeucht / footprints
  https://footprints.baulab.info
  ☆17Updated 10 months ago
• yuzhaouoe / pretraining-data-packing
  [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training
  ☆22Updated last year
• ZurichNLP / mbr
  Minimum Bayes Risk Decoding for Hugging Face Transformers
  ☆58Updated last year
• mlfoundations / scaling
  Language models scale reliably with over-training and on downstream tasks
  ☆98Updated last year
• ThomasScialom / T0_continual_learning
  Adding new tasks to T0 without catastrophic forgetting
  ☆33Updated 2 years ago
• mcleish7 / gemstone-scaling-laws
  ☆28Updated 6 months ago
• allenai / bff
  ☆39Updated last year
• Leukas / CUTE
  ☆14Updated 3 months ago
• ekinakyurek / influence
  Code for "Tracing Knowledge in Language Models Back to the Training Data"
  ☆39Updated 2 years ago
• bminixhofer / zett
  Code for Zero-Shot Tokenizer Transfer
  ☆135Updated 7 months ago
• kaistAI / factual-knowledge-acquisition
  ☆22Updated 3 weeks ago
• guy-dar / embedding-space
  ☆53Updated 2 years ago
• frankxu2004 / knnlm-why
  Repo for ICML23 "Why do Nearest Neighbor Language Models Work?"
  ☆58Updated 2 years ago
• jmerullo / lm_vector_arithmetic
  ☆36Updated 2 years ago
• Nix07 / finetuning
  This repository contains the code used for the experiments in the paper "Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity…
  ☆28Updated last year
• bminixhofer / tokenkit
  A toolkit implementing advanced methods to transfer models and model knowledge across tokenizers.
  ☆44Updated last month
• nathanhu0 / CaMeLS
  Codebase for Context-aware Meta-learned Loss Scaling (CaMeLS). https://arxiv.org/abs/2305.15076.
  ☆25Updated last year
• hadasah / btm
  ☆75Updated last year
• hamishivi / automated-instruction-selection
  Exploration of automated dataset selection approaches at large scales.
  ☆47Updated 6 months ago
• CyberAgentAILab / filtered-dpo
  Introducing Filtered Direct Preference Optimization (fDPO) that enhances language model alignment with human preferences by discarding lo…
  ☆16Updated 9 months ago
• pietrolesci / memorisation-profiles
  This is the official implementation for our ACL 2024 paper: "Causal Estimation of Memorisation Profiles".
  ☆23Updated 5 months ago
• shadowkiller33 / Contrast-Instruction
  ☆19Updated last year
• ahans30 / goldfish-loss
  [NeurIPS 2024] Goldfish Loss: Mitigating Memorization in Generative LLMs
  ☆90Updated 9 months ago
• McGill-NLP / retriever-lm-reasoning
  Code for "Can Retriever-Augmented Language Models Reason? The Blame Game Between the Retriever and the Language Model", EMNLP Findings 20…
  ☆28Updated last year
• tml-epfl / icl-alignment
  Is In-Context Learning Sufficient for Instruction Following in LLMs? [ICLR 2025]
  ☆31Updated 7 months ago
• TristanThrush / perplexity-correlations
  Simple and scalable tools for data-driven pretraining data selection.
  ☆25Updated 2 months ago
• PiotrNawrot / dynamic-pooling
  Efficient Transformers with Dynamic Token Pooling
  ☆63Updated 2 years ago
• ShiZhengyan / InstructionModelling
  [NeurIPS 2024 Main Track] Code for the paper titled "Instruction Tuning With Loss Over Instructions"
  ☆39Updated last year