LLM360 / MegaMath
An Open Math Pre-trainng Dataset with 370B Tokens.
☆78Updated last month
Alternatives and similar repositories for MegaMath:
Users that are interested in MegaMath are comparing it to the libraries listed below
- Advancing Language Model Reasoning through Reinforcement Learning and Inference Scaling☆101Updated 3 months ago
- A Comprehensive Survey on Long Context Language Modeling☆138Updated last month
- The official repository of the Omni-MATH benchmark.☆83Updated 4 months ago
- General Reasoner: Advancing LLM Reasoning Across All Domains☆77Updated this week
- ☆102Updated 5 months ago
- Code for "Critique Fine-Tuning: Learning to Critique is More Effective than Learning to Imitate"☆141Updated 2 weeks ago
- [NeurIPS 2024] OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI☆101Updated 2 months ago
- ☆62Updated last month
- Revisiting Mid-training in the Era of RL Scaling☆36Updated 2 weeks ago
- Code for Paper: Teaching Language Models to Critique via Reinforcement Learning☆94Updated 3 weeks ago
- Reformatted Alignment☆115Updated 7 months ago
- ☆149Updated last week
- Official codebase for "GenPRM: Scaling Test-Time Compute of Process Reward Models via Generative Reasoning".☆72Updated 2 weeks ago
- We aim to provide the best references to search, select, and synthesize high-quality and large-quantity data for post-training your LLMs.☆54Updated 7 months ago
- ☆81Updated last year
- Official github repo for the paper "Compression Represents Intelligence Linearly" [COLM 2024]☆134Updated 7 months ago
- [ACL 2024 Findings] MathBench: A Comprehensive Multi-Level Difficulty Mathematics Evaluation Dataset☆98Updated 9 months ago
- On Memorization of Large Language Models in Logical Reasoning☆65Updated last month
- The implementation of paper "LLM Critics Help Catch Bugs in Mathematics: Towards a Better Mathematical Verifier with Natural Language Fee…☆39Updated 9 months ago
- ☆153Updated last month
- ☆46Updated 2 months ago
- ☆47Updated 4 months ago
- [ICLR 2025] Benchmarking Agentic Workflow Generation☆89Updated 2 months ago
- Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models☆132Updated 10 months ago
- A Large-Scale, Challenging, Decontaminated, and Verifiable Mathematical Dataset for Advancing Reasoning☆180Updated this week
- ☆192Updated 2 months ago
- ☆92Updated 3 months ago
- xVerify: Efficient Answer Verifier for Reasoning Model Evaluations☆90Updated 3 weeks ago
- A Large-Scale, High-Quality Math Dataset for Reinforcement Learning in Language Models☆51Updated 2 months ago
- From Hours to Minutes: Lossless Acceleration of Ultra Long Sequence Generation☆89Updated last month