Code for "Echo Chamber: RL Post-training Amplifies Behaviors Learned in Pretraining"
☆30Oct 14, 2025Updated 10 months ago
Alternatives and similar repositories for openrlhf-pretrain
Users that are interested in openrlhf-pretrain are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official Repository of Paper "Watch the Weights: Unsupervised monitoring and control of fine-tuned LLMs"☆15Sep 25, 2025Updated 11 months ago
- Exploration of automated dataset selection approaches at large scales.☆56Mar 4, 2025Updated last year
- ☆12Apr 25, 2022Updated 4 years ago
- Official Code Repository for [AutoScale📈: Scale-Aware Data Mixing for Pre-Training LLMs] Published as a conference paper at **COLM 2025*…☆14Aug 8, 2025Updated last year
- Code for Continual Learning of Control Primitives☆18Nov 11, 2020Updated 5 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A Sober Look at Language Model Reasoning☆92Nov 18, 2025Updated 9 months ago
- A project designed to build and render a full Minecraft crafting tree.☆10Aug 10, 2021Updated 5 years ago
- ☆27Feb 20, 2026Updated 6 months ago
- ☆26Apr 10, 2025Updated last year
- Revisiting Mid-training in the Era of Reinforcement Learning Scaling☆188Jul 23, 2025Updated last year
- Code and data from the paper 'Human Feedback is not Gold Standard'☆20Aug 9, 2026Updated 3 weeks ago
- Fairer Preferences Elicit Improved Human-Aligned Large Language Model Judgments (Zhou et al., EMNLP 2024)☆14Oct 3, 2024Updated last year
- [ICML 2026 Spotlight] On the Interplay of Pre-Training, Mid-Training, and RL on Reasoning Language Models☆166Jun 8, 2026Updated 3 months ago
- ☆46Sep 27, 2025Updated 11 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Code for "What really matters in matrix-whitening optimizers?"☆25Oct 31, 2025Updated 10 months ago
- Distributional Successor Features Enable Zero-Shot Policy Optimization☆15Apr 11, 2025Updated last year
- Code for reproducing our paper "Low Rank Adapting Models for Sparse Autoencoder Features"☆17Mar 31, 2025Updated last year
- The official code release for Q#: Provably Optimal Distributional RL for LLM Post-Training☆21Mar 4, 2025Updated last year
- Implementation of Gradient Information Optimization (GIO) for effective and scalable training data selection☆14Jun 22, 2023Updated 3 years ago
- Computing the greatest common divisor with transformers, source code for the paper https//arxiv.org/abs/2308.15594☆14Aug 11, 2025Updated last year
- MetaC provides a read-eval-print loop (a REPL) and notebook interactive development environment (a NIDE) for C programming. MetaC also …☆12Aug 17, 2026Updated 3 weeks ago
- Implementation of ICML 2023 paper: Future-conditioned Unsupervised Pretraining for Decision Transformer☆29Jul 25, 2023Updated 3 years ago
- ☆35Jul 5, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Benchmarking Optimizers for LLM Pretraining☆60May 3, 2026Updated 4 months ago
- This repository contains the code used for the experiments in the paper "Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity…☆32Oct 27, 2025Updated 10 months ago
- ThetaEvolve: Test-time Learning on Open Problems, enabling RL training on AlphaEvolve/OpenEvolve and emphasizing scaling test-time comput…☆176Feb 27, 2026Updated 6 months ago
- ☆28Aug 9, 2025Updated last year
- This is the official implementation for our ACL 2024 paper: "Causal Estimation of Memorisation Profiles".☆25Mar 25, 2025Updated last year
- Official Code for What Makes and Breaks Safety Fine-tuning? A Mechanistic Study (NeurIPS 2024)☆11Oct 31, 2024Updated last year
- Code for paper "Hierarchically Decoupled Imitation for Morphological Transfer"☆17Mar 24, 2023Updated 3 years ago
- Code for the paper "Learning Options via Compression" at NeurIPS 2022☆28Jan 11, 2023Updated 3 years ago
- This is the official implementation for paper "PENCIL: Long Thoughts with Short Memory".☆81May 9, 2025Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ☆280Dec 2, 2024Updated last year
- [ICML 2026] Heima☆76May 20, 2026Updated 3 months ago
- Flax (JAX) implementation of Progressive Growing of GANs for Improved Quality, Stability, and Variation☆12May 24, 2021Updated 5 years ago
- Defeating the Training-Inference Mismatch via FP16☆197Nov 14, 2025Updated 9 months ago
- A local search system implementation using Elasticsearch for Wikipedia data indexing and retrieval.☆14May 17, 2025Updated last year
- ☆54Feb 12, 2025Updated last year
- [TMLR] Process Reward Models That Think☆92Jul 30, 2026Updated last month