Alternatives and similar repositories for AsymmetryLoRA

Users that are interested in AsymmetryLoRA are comparing it to the libraries listed below

• alexrame / rewardedsoups
  Rewarded soups official implementation
  ☆60Updated last year
• VITA-Group / Junk_DNA_Hypothesis
  [ICML 2024] Junk DNA Hypothesis: A Task-Centric Angle of LLM Pre-trained Weights through Sparsity; Lu Yin*, Ajay Jaiswal*, Shiwei Liu, So…
  ☆16Updated 4 months ago
• ZHZisZZ / emulated-disalignment
  [ACL'24, Outstanding Paper] Emulated Disalignment: Safety Alignment for Large Language Models May Backfire!
  ☆38Updated last year
• holarissun / RewardModelingBeyondBradleyTerry
  official implementation of ICLR'2025 paper: Rethinking Bradley-Terry Models in Preference-based Reward Modeling: Foundations, Theory, and…
  ☆66Updated 4 months ago
• EnnengYang / RepresentationSurgery
  Representation Surgery for Multi-Task Model Merging. ICML, 2024.
  ☆46Updated 10 months ago
• ryoungj / BoLT
  Code for "Reasoning to Learn from Latent Thoughts"
  ☆116Updated 4 months ago
• bethgelab / sober-reasoning
  A Sober Look at Language Model Reasoning
  ☆81Updated 2 months ago
• VITA-Group / SEAL
  Official code for SEAL: Steerable Reasoning Calibration of Large Language Models for Free
  ☆40Updated 4 months ago
• Model-GLUE / Model-GLUE
  ☆15Updated last year
• princeton-pli / what-makes-good-rm
  What Makes a Reward Model a Good Teacher? An Optimization Perspective
  ☆36Updated 2 months ago
• shizhediao / Black-Box-Prompt-Learning
  Source code for the TMLR paper "Black-Box Prompt Learning for Pre-trained Language Models"
  ☆56Updated last year
• locuslab / acr-memorization
  ☆36Updated 8 months ago
• UKPLab / iclr2024-model-merging
  This is the repository for "Model Merging by Uncertainty-Based Gradient Matching", ICLR 2024.
  ☆28Updated last year
• abhishekpanigrahi1996 / Skill-Localization-by-grafting
  ☆51Updated last year
• siyan-zhao / ICL_decision_boundary
  official code for paper Probing the Decision Boundaries of In-context Learning in Large Language Models. https://arxiv.org/abs/2406.11233…
  ☆19Updated last month
• socialfoundations / tttlm
  Test-time-training on nearest neighbors for large language models
  ☆45Updated last year
• YangRui2015 / RiC
  Code for the ICML 2024 paper "Rewards-in-Context: Multi-objective Alignment of Foundation Models with Dynamic Preference Adjustment"
  ☆72Updated 2 months ago
• tianjunz / TEMPERA
  ☆46Updated 2 years ago
• deeplearning-wisc / args
  ☆44Updated last year
• YangRui2015 / Generalizable-Reward-Model
  Code for NeurIPS 2024 paper "Regularizing Hidden States Enables Learning Generalizable Reward Model for LLMs"
  ☆38Updated 6 months ago
• erosenfeld / disagree_discrep
  Provably (and non-vacuously) bounding test error of deep neural networks under distribution shift with unlabeled test data.
  ☆10Updated last year
• sail-sg / Attention-Sink
  [ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)
  ☆118Updated last month
• allenbai01 / transformers-as-statisticians
  ☆33Updated 2 years ago
• vfleaking / PTST
  Code for safety test in "Keeping LLMs Aligned After Fine-tuning: The Crucial Role of Prompt Templates"
  ☆18Updated last year
• liziniu / policy_optimization
  Code for Paper (Policy Optimization in RLHF: The Impact of Out-of-preference Data)
  ☆28Updated last year
• ZHZisZZ / modpo
  [ACL'24] Beyond One-Preference-Fits-All Alignment: Multi-Objective Direct Preference Optimization
  ☆85Updated last year
• princeton-nlp / unintentional-unalignment
  [ICLR 2025] Unintentional Unalignment: Likelihood Displacement in Direct Preference Optimization
  ☆30Updated 7 months ago
• shiqiangw / iclr-scores
  ☆54Updated 9 months ago
• srzer / MOD
  Official code for "Decoding-Time Language Model Alignment with Multiple Objectives".
  ☆25Updated 9 months ago
• YefanZhou / TempBalance
  [NeurIPS 2023 Spotlight] Temperature Balancing, Layer-wise Weight Analysis, and Neural Network Training
  ☆35Updated 4 months ago