abaheti95 / LoL-RL
Advantage Leftover Lunch Reinforcement Learning (A-LoL RL): Improving Language Models with Advantage-based Offline Policy Gradients
☆26Updated 7 months ago
Alternatives and similar repositories for LoL-RL:
Users that are interested in LoL-RL are comparing it to the libraries listed below
- Self-Supervised Alignment with Mutual Information☆17Updated 11 months ago
- ☆31Updated 4 months ago
- Code for LaMPP: Language Models as Probabilistic Priors for Perception and Action☆36Updated 2 years ago
- This is code for most of the experiments in the paper Understanding the Effects of RLHF on LLM Generalisation and Diversity☆43Updated last year
- Learning from preferences is a common paradigm for fine-tuning language models. Yet, many algorithmic design decisions come into play. Ou…☆28Updated last year
- Dateset Reset Policy Optimization☆30Updated last year
- Directional Preference Alignment☆57Updated 7 months ago
- Official PyTorch Implementation of the Longhorn Deep State Space Model☆50Updated 4 months ago
- A testbed for agents and environments that can automatically improve models through data generation.☆23Updated last month
- ☆15Updated 5 months ago
- Q-Probe: A Lightweight Approach to Reward Maximization for Language Models☆41Updated 10 months ago
- Official Code Repository for EnvGen: Generating and Adapting Environments via LLMs for Training Embodied Agents (COLM 2024)☆29Updated 9 months ago
- NeurIPS 2024 tutorial on LLM Inference☆41Updated 4 months ago
- Rewarded soups official implementation☆58Updated last year
- ☆33Updated last month
- Guide Your Agent with Adaptive Multimodal Rewards (NeurIPS 2023 Accepted)☆33Updated last year
- Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"☆26Updated last year
- ☆90Updated 9 months ago
- Efficient Scaling laws and collaborative pretraining.☆16Updated 2 months ago
- Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"☆47Updated last year
- ICML 2024 - Official Repository for EXO: Towards Efficient Exact Optimization of Language Model Alignment☆55Updated 10 months ago
- ☆31Updated 3 months ago
- ☆18Updated 9 months ago
- Repository for Skill Set Optimization☆12Updated 8 months ago
- Online Adaptation of Language Models with a Memory of Amortized Contexts (NeurIPS 2024)☆63Updated 8 months ago
- Code for the paper: Dense Reward for Free in Reinforcement Learning from Human Feedback (ICML 2024) by Alex J. Chan, Hao Sun, Samuel Holt…☆28Updated 8 months ago
- SimPER: A Minimalist Approach to Preference Alignment without Hyperparameters (ICLR 2025)☆11Updated 3 weeks ago
- ☆16Updated last year
- [ACL 2024] Masked Thought: Simply Masking Partial Reasoning Steps Can Improve Mathematical Reasoning Learning of Language Models☆19Updated 9 months ago
- Code for Paper (Policy Optimization in RLHF: The Impact of Out-of-preference Data)☆28Updated last year