tlc4418 / llm_optimization

Related projects ⓘ

Alternatives and complementary repositories for llm_optimization

• alexrame / rewardedsoups
  Rewarded soups official implementation
  ☆51Updated last year
• deeplearning-wisc / args
  ☆33Updated 9 months ago
• abdulhaim / LMRL-Gym
  ☆73Updated 4 months ago
• facebookresearch / rlfh-gen-div
  This is code for most of the experiments in the paper Understanding the Effects of RLHF on LLM Generalisation and Diversity
  ☆38Updated 10 months ago
• liziniu / policy_optimization
  Code for Paper (Policy Optimization in RLHF: The Impact of Out-of-preference Data)
  ☆23Updated 11 months ago
• XanderJC / attention-based-credit
  Code for the paper: Dense Reward for Free in Reinforcement Learning from Human Feedback (ICML 2024) by Alex J. Chan, Hao Sun, Samuel Holt…
  ☆20Updated 3 months ago
• YifeiZhou02 / ArCHer
  Research Code for "ArCHer: Training Language Model Agents via Hierarchical Multi-Turn RL"
  ☆108Updated 7 months ago
• Edward-Sun / easy-to-hard
  Easy-to-Hard Generalization: Scalable Alignment Beyond Human Supervision
  ☆97Updated 2 months ago
• jamqd / Group-Preference-Optimization
  ☆14Updated 8 months ago
• alecwangcq / f-divergence-dpo
  Direct preference optimization with f-divergences.
  ☆12Updated 2 weeks ago
• ZHZisZZ / modpo
  [ACL'24] Beyond One-Preference-Fits-All Alignment: Multi-Objective Direct Preference Optimization
  ☆55Updated 3 months ago
• ZHZisZZ / emulated-disalignment
  [ACL'24, Outstanding Paper] Emulated Disalignment: Safety Alignment for Large Language Models May Backfire!
  ☆29Updated 3 months ago
• sail-sg / oat
  🌾 OAT: Online AlignmenT for LLMs
  ☆32Updated last week
• McGill-NLP / VinePPO
  Code for the paper "VinePPO: Unlocking RL Potential For LLM Reasoning Through Refined Credit Assignment"
  ☆80Updated last week
• Shentao-YANG / Preference_Grounded_Guidance
  Source codes for "Preference-grounded Token-level Guidance for Language Model Fine-tuning" (NeurIPS 2023).
  ☆14Updated last year
• cassidylaidlaw / hidden-context
  Code and data for the paper "Understanding Hidden Context in Preference Learning: Consequences for RLHF"
  ☆27Updated 11 months ago
• YangRui2015 / RiC
  Code for the ICML 2024 paper "Rewards-in-Context: Multi-objective Alignment of Foundation Models with Dynamic Preference Adjustment"
  ☆48Updated 2 weeks ago
• Linear95 / APO
  Code for ACL2024 paper - Adversarial Preference Optimization (APO).
  ☆49Updated 5 months ago
• ajyl / dpo_toxic
  A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.
  ☆57Updated 2 weeks ago
• jbloomAus / DecisionTransformerInterpretability
  Interpreting how transformers simulate agents performing RL tasks
  ☆73Updated last year
• Sea-Snell / Implicit-Language-Q-Learning
  Official code from the paper "Offline RL for Natural Language Generation with Implicit Language Q Learning"
  ☆199Updated last year
• jon--lee / decision-pretrained-transformer
  Implemention of the Decision-Pretrained Transformer (DPT) from the paper Supervised Pretraining Can Learn In-Context Reinforcement Learni…
  ☆54Updated 5 months ago
• zlin7 / UQ-NLG
  ☆77Updated 4 months ago
• snu-mllab / DPPO
  Official implementation of "Direct Preference-based Policy Optimization without Reward Modeling" (NeurIPS 2023)
  ☆38Updated 4 months ago
• micahcarroll / uniMASK
  Codebase for "Uni[MASK]: Unified Inference in Sequential Decision Problems"
  ☆54Updated 4 months ago
• machelreid / can-wikipedia-help-offline-rl
  Official code for "Can Wikipedia Help Offline Reinforcement Learning?" by Machel Reid, Yutaro Yamada and Shixiang Shane Gu
  ☆101Updated 2 years ago
• aviclu / ffn-values
  ☆58Updated last year
• ZhaolinGao / REBEL
  ☆25Updated 3 weeks ago
• ahjwang / messenger-emma
  Implements the Messenger environment and EMMA model.
  ☆23Updated last year
• HosnLS / Hierarchical-Language-Agent
  ☆22Updated 10 months ago