Code for "Echo Chamber: RL Post-training Amplifies Behaviors Learned in Pretraining"
☆30Oct 14, 2025Updated last year
Alternatives and similar repositories for openrlhf-pretrain
Users that are interested in openrlhf-pretrain are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Codebase for the paper "A Percolation Model of Emergence: Analyzing Transformers Trained on a Formal Language"☆11Oct 11, 2024Updated 2 years ago
- A code repository accompanying the paper "Transformers, parallel computation, and logarithmic depth" by Clayton Sanford, Daniel Hsu, and …☆12Feb 15, 2024Updated 2 years ago
- ☆15Sep 29, 2022Updated 4 years ago
- Official code for the paper Scale leads to compositional generalization.☆13Jul 11, 2025Updated last year
- Code for "On Expressive Power of Looped Transformers: Theoretical Analysis and Enhancement via Timestep Encoding (ICML 2025)"☆10Jun 29, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆76Jun 23, 2025Updated last year
- Official Repository of Paper "Watch the Weights: Unsupervised monitoring and control of fine-tuned LLMs"☆15Sep 25, 2025Updated last year
- ☆35May 16, 2025Updated last year
- In-context Example Selection with Influences☆15May 12, 2023Updated 3 years ago
- ☆13Apr 25, 2022Updated 4 years ago
- Repo for "STAR: Spectral Truncation and Rescale for Model Merging" [NAACL 2025]☆11Oct 22, 2026Updated 2 weeks ago
- Reproducing GPT on the TinyStories dataset☆22Jan 18, 2024Updated 2 years ago
- Code for Continual Learning of Control Primitives☆18Nov 11, 2020Updated 5 years ago
- Exploration of automated dataset selection approaches at large scales.☆56Mar 4, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A Sober Look at Language Model Reasoning☆92Nov 18, 2025Updated 11 months ago
- A project designed to build and render a full Minecraft crafting tree.☆10Aug 10, 2021Updated 5 years ago
- The Full Spectrum of Deepnet Hessians at Scale: Dynamics with SGD Training and Sample Size☆19May 19, 2019Updated 7 years ago
- Revisiting Mid-training in the Era of Reinforcement Learning Scaling☆188Jul 23, 2025Updated last year
- ☆47Sep 27, 2025Updated last year
- Code and data from the paper 'Human Feedback is not Gold Standard'☆21Aug 9, 2026Updated 2 months ago
- Fairer Preferences Elicit Improved Human-Aligned Large Language Model Judgments (Zhou et al., EMNLP 2024)☆14Oct 3, 2024Updated 2 years ago
- [ICML 2026 Spotlight] On the Interplay of Pre-Training, Mid-Training, and RL on Reasoning Language Models☆170Jun 8, 2026Updated 4 months ago
- ☆27Apr 10, 2025Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Official Code Repository for [AutoScale📈: Scale-Aware Data Mixing for Pre-Training LLMs] Published as a conference paper at **COLM 2025*…☆14Aug 8, 2025Updated last year
- Code to accompany the paper "The Information Geometry of Unsupervised Reinforcement Learning"☆20Oct 6, 2021Updated 5 years ago
- Visualization of mean field and neural tangent kernel regime☆23Jul 25, 2024Updated 2 years ago
- Official Code for our paper: "Language Models Learn to Mislead Humans via RLHF""☆20Oct 11, 2024Updated 2 years ago
- ☆10Jan 25, 2025Updated last year
- ☆29Feb 20, 2026Updated 8 months ago
- Official implementation of "MoDoMoDo: Multi-Domain Data Mixtures for Multimodal LLM Reinforcement Learning"☆11Aug 23, 2025Updated last year
- Code for reproducing our paper "Low Rank Adapting Models for Sparse Autoencoder Features"☆17Mar 31, 2025Updated last year
- The official code release for Q#: Provably Optimal Distributional RL for LLM Post-Training☆21Mar 4, 2025Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Implementation of Gradient Information Optimization (GIO) for effective and scalable training data selection☆14Jun 22, 2023Updated 3 years ago
- Easy-to-Hard Generalization: Scalable Alignment Beyond Human Supervision☆124Sep 9, 2024Updated 2 years ago
- Design and analyze optimal deep learning models.☆32Aug 2, 2025Updated last year
- ☆10Jul 27, 2026Updated 3 months ago
- Implementation of ICML 2023 paper: Future-conditioned Unsupervised Pretraining for Decision Transformer☆29Jul 25, 2023Updated 3 years ago
- ☆29Aug 9, 2025Updated last year
- Distributional Successor Features Enable Zero-Shot Policy Optimization☆15Apr 11, 2025Updated last year