Alternatives and similar repositories for MAC:

Users that are interested in MAC are comparing it to the libraries listed below

• RLHFlow / Directional-Preference-Alignment
  Directional Preference Alignment
  ☆57Updated 7 months ago
• hbin0701 / Self-Explore
  [𝐄𝐌𝐍𝐋𝐏 𝐅𝐢𝐧𝐝𝐢𝐧𝐠𝐬 𝟐𝟎𝟐𝟒 & 𝐀𝐂𝐋 𝟐𝟎𝟐𝟒 𝐍𝐋𝐑𝐒𝐄 𝐎𝐫𝐚𝐥] 𝘌𝘯𝘩𝘢𝘯𝘤𝘪𝘯𝘨 𝘔𝘢𝘵𝘩𝘦𝘮𝘢𝘵𝘪𝘤𝘢𝘭 𝘙𝘦𝘢𝘴𝘰𝘯𝘪𝘯…
  ☆50Updated last year
• gregorbachmann / Next-Token-Failures
  ☆84Updated last year
• sail-sg / dice
  Official implementation of Bootstrapping Language Models via DPO Implicit Rewards
  ☆44Updated 3 weeks ago
• joeljang / RLPHF
  Personalized Soups: Personalized Large Language Model Alignment via Post-hoc Parameter Merging
  ☆100Updated last year
• janphilippfranken / sami
  Self-Supervised Alignment with Mutual Information
  ☆18Updated 11 months ago
• tengxiao1 / SimPER
  SimPER: A Minimalist Approach to Preference Alignment without Hyperparameters (ICLR 2025)
  ☆12Updated last month
• deeplearning-wisc / args
  ☆40Updated last year
• Jiuzhouh / Uncertainty-Aware-Language-Agent
  This is the official repo for Towards Uncertainty-Aware Language Agent.
  ☆24Updated 8 months ago
• haozheji / exact-optimization
  ICML 2024 - Official Repository for EXO: Towards Efficient Exact Optimization of Language Model Alignment
  ☆55Updated 10 months ago
• SumilerGAO / SunGen
  ☆25Updated 2 years ago
• RLHFlow / RAFT
  This is an official implementation of the Reward rAnked Fine-Tuning Algorithm (RAFT), also known as iterative best-of-n fine-tuning or re…
  ☆29Updated 7 months ago
• yegcjs / DiffusionLLM
  Code for paper "Diffusion Language Models Can Perform Many Tasks with Scaling and Instruction-Finetuning"
  ☆76Updated last year
• Edward-Sun / easy-to-hard
  Easy-to-Hard Generalization: Scalable Alignment Beyond Human Supervision
  ☆120Updated 7 months ago
• Shentao-YANG / Preference_Grounded_Guidance
  Source codes for "Preference-grounded Token-level Guidance for Language Model Fine-tuning" (NeurIPS 2023).
  ☆16Updated 3 months ago
• facebookresearch / RLCD
  Reproduction of "RLCD Reinforcement Learning from Contrast Distillation for Language Model Alignment
  ☆69Updated last year
• RUCAIBox / RLMEC
  The official repository of "Improving Large Language Models via Fine-grained Reinforcement Learning with Minimum Editing Constraint"
  ☆38Updated last year
• SynthLabsAI / big-math
  A Large-Scale, High-Quality Math Dataset for Reinforcement Learning in Language Models
  ☆51Updated 2 months ago
• Linear95 / DSP
  Domain-specific preference (DSP) data and customized RM fine-tuning.
  ☆25Updated last year
• roeehendel / icl_task_vectors
  ☆93Updated last year
• thu-ml / Noise-Contrastive-Alignment
  Code accompanying the paper "Noise Contrastive Alignment of Language Models with Explicit Rewards" (NeurIPS 2024)
  ☆51Updated 5 months ago
• Pranjal2041 / AdaptiveConsistency
  Let's Sample Step by Step: Adaptive-Consistency for Efficient Reasoning with LLMs
  ☆36Updated last year
• wzhouad / WPO
  Code and models for EMNLP 2024 paper "WPO: Enhancing RLHF with Weighted Preference Optimization"
  ☆40Updated 7 months ago
• PKU-ML / LongPPL
  Code for ICLR 2025 Paper "What is Wrong with Perplexity for Long-context Language Modeling?"
  ☆58Updated last month
• facebookresearch / rlfh-gen-div
  This is code for most of the experiments in the paper Understanding the Effects of RLHF on LLM Generalisation and Diversity
  ☆43Updated last year
• PrasannS / rlhf-length-biases
  ☆28Updated last year
• BeyonderXX / TRACE
  TRACE: A Comprehensive Benchmark for Continual Learning in Large Language Models
  ☆67Updated last year
• tml-epfl / long-is-more-for-alignment
  Long Is More for Alignment: A Simple but Tough-to-Beat Baseline for Instruction Fine-Tuning [ICML 2024]
  ☆17Updated last year
• tianjunz / TEMPERA
  ☆44Updated 2 years ago
• genrm-star / genrm-critiques
  GenRM-CoT: Data release for verification rationales
  ☆56Updated 6 months ago