A repo for RLHF training and BoN over LLMs, with support for reward model ensembles.
☆51Jan 16, 2025Updated last year
Alternatives and similar repositories for llm_optimization
Users that are interested in llm_optimization are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The official implementation of InfoRM [NeurIPS 2024].☆16Oct 17, 2026Updated 2 weeks ago
- The code of “Improving Weak-to-Strong Generalization with Scalable Oversight and Ensemble Learning”☆17Feb 26, 2024Updated 2 years ago
- [AAAI 2025 oral] Evaluating Mathematical Reasoning Beyond Accuracy☆80Oct 9, 2025Updated last year
- Rewarded soups official implementation☆66Sep 27, 2023Updated 3 years ago
- A simulation framework for RLHF and alternatives. Develop your RLHF method without collecting human data.☆844Jul 1, 2024Updated 2 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- ☆14Sep 11, 2022Updated 4 years ago
- Code for the ICML 2024 paper "Rewards-in-Context: Multi-objective Alignment of Foundation Models with Dynamic Preference Adjustment"☆78Jun 10, 2025Updated last year
- ☆48Mar 25, 2025Updated last year
- Code for NeurIPS'23 paper "A Bayesian Approach To Analysing Training Data Attribution In Deep Learning"☆17Jan 12, 2024Updated 2 years ago
- Code for ICLR 2025 Paper "GenARM: Reward Guided Generation with Autoregressive Reward Model for Test-time Alignment"☆25Feb 10, 2025Updated last year
- a benchmark suite for testing logical reasoning abilities of prompt-based models☆31Nov 20, 2023Updated 2 years ago
- This repo contains code for paper: "Uncertainty Estimation and Quantification for LLMs: A Simple Supervised Approach".☆26Oct 21, 2024Updated 2 years ago
- ☆22Dec 17, 2020Updated 5 years ago
- This is an official implementation of the paper ``Building Math Agents with Multi-Turn Iterative Preference Learning'' with multi-turn DP…☆31Dec 5, 2024Updated last year
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- ☆165Nov 23, 2024Updated last year
- iQRL: implicitly Quantized Representations for Sample-efficient Reinforcement Learning☆12Jan 8, 2025Updated last year
- ☆12Mar 7, 2024Updated 2 years ago
- LLM-as-an-Interviewer: Beyond Static Testing Through Dynamic LLM Evaluation (ACL findings 2025)☆33May 21, 2026Updated 5 months ago
- Code for "CREAM: Consistency Regularized Self-Rewarding Language Models", ICLR 2025.☆30Feb 17, 2025Updated last year
- [ICLR 2025] Code&Data for the paper "Super(ficial)-alignment: Strong Models May Deceive Weak Models in Weak-to-Strong Generalization"☆15Jun 21, 2024Updated 2 years ago
- Official Code Repository for [AutoScale📈: Scale-Aware Data Mixing for Pre-Training LLMs] Published as a conference paper at **COLM 2025*…☆14Aug 8, 2025Updated last year
- Code and Configs for Asynchronous RLHF: Faster and More Efficient RL for Language Models (ICLR 2025)☆70Oct 19, 2026Updated 2 weeks ago
- Dataset Interfaces: Diagnosing Model Failures Using Controllable Counterfactual Generation☆45Feb 27, 2023Updated 3 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Code for Preventing Language Models From Hiding Their Reasoning, which evaluates defenses against LLM steganography.☆25Oct 6, 2026Updated 3 weeks ago
- Code repo for the NeurIPS 2021 paper "Online Adaption to Label Distribution Shift".☆16Feb 15, 2023Updated 3 years ago
- Implementing FastSent in theano☆12May 2, 2016Updated 10 years ago
- ☆26Feb 27, 2022Updated 4 years ago
- https://huggingface.co/spaces/WildVision/vision-arena☆13Nov 9, 2024Updated last year
- FVQ: A Large-Scale Dataset and an LMM-based Method for Face Video Quality Assessment (ACM MM 2025)☆10Feb 5, 2026Updated 8 months ago
- Uncertainty-Aware Curriculum Learning for Neural Machine Translation (ACL 2020)☆11Jun 12, 2020Updated 6 years ago
- ☆48Feb 8, 2024Updated 2 years ago
- Scaling Pareto-Efficient Decision Making via Offline Multi-Objective RL, published in ICLR 2023☆34Dec 7, 2024Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- [ICML'24] Open-Vocabulary Calibration for Fine-tuned CLIP☆18Jun 14, 2024Updated 2 years ago
- [NeurIPS 2025@FoRLM] R1-Compress: Long Chain-of-Thought Compression via Chunk Compression and Search☆17Jan 24, 2026Updated 9 months ago
- An official implementation of "Rethinking Graph Backdoor Attacks: A Distribution-Preserving Perspective" (KDD 2024)☆12Sep 16, 2024Updated 2 years ago
- [NeurIPS 2026] Official implementation of Contrastive Distribution Matching for Amortized Sequential Monte Carlo in Discrete Diffusion☆15Oct 1, 2026Updated last month
- Yet another dynamic batch sampler for variable sequence data in PyTorch.☆14Dec 9, 2021Updated 4 years ago
- AI Control evaluation library. Built natively on Inspect AI.☆17Feb 25, 2026Updated 8 months ago
- RewardBench: the first evaluation tool for reward models.☆748Oct 14, 2026Updated 2 weeks ago