GAIR-NLP / OctoThinker
Revisiting Mid-training in the Era of RL Scaling
☆27Updated this week
Alternatives and similar repositories for OctoThinker:
Users that are interested in OctoThinker are comparing it to the libraries listed below
- The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling☆29Updated last month
- Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"☆47Updated last year
- A Large-Scale, High-Quality Math Dataset for Reinforcement Learning in Language Models☆47Updated 2 months ago
- ☆31Updated 3 months ago
- Exploration of automated dataset selection approaches at large scales.☆39Updated last month
- Codebase for Instruction Following without Instruction Tuning☆34Updated 7 months ago
- Code for ICLR 2025 Paper "What is Wrong with Perplexity for Long-context Language Modeling?"☆53Updated 3 weeks ago
- Code for "Reasoning to Learn from Latent Thoughts"☆91Updated 3 weeks ago
- Repository for NPHardEval, a quantified-dynamic benchmark of LLMs☆53Updated last year
- Advancing Language Model Reasoning through Reinforcement Learning and Inference Scaling☆101Updated 3 months ago
- [NeurIPS 2024] OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI☆100Updated last month
- Script for processing OpenAI's PRM800K process supervision dataset into an Alpaca-style instruction-response format☆27Updated last year
- ☆24Updated 7 months ago
- ☆46Updated 2 months ago
- ☆36Updated last month
- The official repository of the Omni-MATH benchmark.☆80Updated 4 months ago
- Code for Paper: Teaching Language Models to Critique via Reinforcement Learning☆94Updated last week
- ☆13Updated 9 months ago
- ☆20Updated 2 months ago
- ☆43Updated last month
- Conic10K: A large-scale dataset for closed-vocabulary math problem understanding. Accepted to EMNLP2023 Findings.☆25Updated last year
- ☆59Updated 7 months ago
- ☆60Updated 11 months ago
- ☆46Updated last month
- ☆22Updated 9 months ago
- Official implementation of Bootstrapping Language Models via DPO Implicit Rewards☆43Updated last week
- ☆23Updated 10 months ago
- Benchmarking Benchmark Leakage in Large Language Models☆51Updated 11 months ago
- Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"☆26Updated last year
- [ICLR'24 spotlight] Tool-Augmented Reward Modeling☆47Updated 3 months ago