Alternatives and similar repositories for ConstrainedRL4LMs:

Users that are interested in ConstrainedRL4LMs are comparing it to the libraries listed below

• alexrame / rewardedsoups
  Rewarded soups official implementation
  ☆54Updated last year
• McGill-NLP / VinePPO
  Code for the paper "VinePPO: Unlocking RL Potential For LLM Reasoning Through Refined Credit Assignment"
  ☆126Updated 3 months ago
• abdulhaim / LMRL-Gym
  ☆79Updated 8 months ago
• YifeiZhou02 / ArCHer
  Research Code for "ArCHer: Training Language Model Agents via Hierarchical Multi-Turn RL"
  ☆136Updated 11 months ago
• tlc4418 / llm_optimization
  A repo for RLHF training and BoN over LLMs, with support for reward model ensembles.
  ☆36Updated last month
• cmu-mind / RISE
  ☆28Updated 4 months ago
• alecwangcq / f-divergence-dpo
  Direct preference optimization with f-divergences.
  ☆13Updated 4 months ago
• genrm-star / genrm-critiques
  GenRM-CoT: Data release for verification rationales
  ☆49Updated 4 months ago
• ZHZisZZ / modpo
  [ACL'24] Beyond One-Preference-Fits-All Alignment: Multi-Objective Direct Preference Optimization
  ☆70Updated 6 months ago
• GFNOrg / gfn-lm-tuning
  ☆171Updated last year
• jon--lee / decision-pretrained-transformer
  Implemention of the Decision-Pretrained Transformer (DPT) from the paper Supervised Pretraining Can Learn In-Context Reinforcement Learni…
  ☆59Updated 9 months ago
• facebookresearch / rlfh-gen-div
  This is code for most of the experiments in the paper Understanding the Effects of RLHF on LLM Generalisation and Diversity
  ☆40Updated last year
• Edward-Sun / easy-to-hard
  Easy-to-Hard Generalization: Scalable Alignment Beyond Human Supervision
  ☆118Updated 5 months ago
• vwxyzjn / lm-human-preference-details
  RLHF implementation details of OAI's 2019 codebase
  ☆181Updated last year
• liziniu / ReMax
  Code for Paper (ReMax: A Simple, Efficient and Effective Reinforcement Learning Method for Aligning Large Language Models)
  ☆175Updated last year
• mxu34 / prompt-dt
  Official code repository for Prompt-DT.
  ☆105Updated 2 years ago
• XanderJC / attention-based-credit
  Code for the paper: Dense Reward for Free in Reinforcement Learning from Human Feedback (ICML 2024) by Alex J. Chan, Hao Sun, Samuel Holt…
  ☆22Updated 6 months ago
• vwxyzjn / summarize_from_feedback_details
  ☆134Updated 3 months ago
• Sea-Snell / Implicit-Language-Q-Learning
  Official code from the paper "Offline RL for Natural Language Generation with Implicit Language Q Learning"
  ☆204Updated last year
• ml-jku / L2M
  Learning to Modulate pre-trained Models in RL (Decision Transformer, LoRA, Fine-tuning)
  ☆54Updated 4 months ago
• ZhaolinGao / REBEL
  ☆28Updated 2 months ago
• deeplearning-wisc / args
  ☆35Updated last year
• csmile-1006 / PreferenceTransformer
  Preference Transformer: Modeling Human Preferences using Transformers for RL (ICLR2023 Accepted)
  ☆159Updated last year
• WooooDyy / LLM-Reverse-Curriculum-RL
  Implementation of the ICML 2024 paper "Training Large Language Models for Reasoning through Reverse Curriculum Reinforcement Learning" pr…
  ☆91Updated last year
• jhejna / cpl
  Code for Contrastive Preference Learning (CPL)
  ☆160Updated 3 months ago
• vwxyzjn / cleanba
  CleanRL's implementation of DeepMind's Podracer Sebulba Architecture for Distributed DRL
  ☆109Updated 6 months ago
• YangRui2015 / RiC
  Code for the ICML 2024 paper "Rewards-in-Context: Multi-objective Alignment of Foundation Models with Dynamic Preference Adjustment"
  ☆57Updated 2 months ago
• snu-mllab / DPPO
  Official implementation of "Direct Preference-based Policy Optimization without Reward Modeling" (NeurIPS 2023)
  ☆41Updated 7 months ago
• flowersteam / lamorel
  Lamorel is a Python library designed for RL practitioners eager to use Large Language Models (LLMs).
  ☆214Updated 3 months ago