LLM360 / MegaMathLinks
An Open Math Pre-trainng Dataset with 370B Tokens.
☆87Updated last month
Alternatives and similar repositories for MegaMath
Users that are interested in MegaMath are comparing it to the libraries listed below
Sorting:
- Advancing Language Model Reasoning through Reinforcement Learning and Inference Scaling☆101Updated 4 months ago
- We aim to provide the best references to search, select, and synthesize high-quality and large-quantity data for post-training your LLMs.☆55Updated 7 months ago
- General Reasoner: Advancing LLM Reasoning Across All Domains☆117Updated this week
- The official repository of the Omni-MATH benchmark.☆83Updated 5 months ago
- Reformatted Alignment☆113Updated 8 months ago
- Code for "Critique Fine-Tuning: Learning to Critique is More Effective than Learning to Imitate"☆151Updated last month
- [ICML 2025] Teaching Language Models to Critique via Reinforcement Learning☆97Updated 3 weeks ago
- [NeurIPS 2024] OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI☆101Updated 2 months ago
- ☆80Updated 2 weeks ago
- ☆82Updated last year
- IKEA: Reinforced Internal-External Knowledge Synergistic Reasoning for Efficient Adaptive Search Agent☆54Updated 2 weeks ago
- ☆66Updated 2 months ago
- ☆102Updated 5 months ago
- Efficient Agent Training for Computer Use☆85Updated this week
- ☆131Updated this week
- ☆150Updated last month
- [ACL 2024 Findings] MathBench: A Comprehensive Multi-Level Difficulty Mathematics Evaluation Dataset☆100Updated last week
- A Comprehensive Survey on Long Context Language Modeling☆146Updated last week
- Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models☆132Updated 11 months ago
- A Large-Scale, Challenging, Decontaminated, and Verifiable Mathematical Dataset for Advancing Reasoning☆192Updated last week
- Revisiting Mid-training in the Era of RL Scaling☆42Updated last month
- On Memorization of Large Language Models in Logical Reasoning☆65Updated 2 months ago
- ☆112Updated this week
- Homepage for ProLong (Princeton long-context language models) and paper "How to Train Long-Context Language Models (Effectively)"☆184Updated 2 months ago
- Official github repo for the paper "Compression Represents Intelligence Linearly" [COLM 2024]☆135Updated 8 months ago
- Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-based LLMs☆166Updated last week
- ☆46Updated 2 months ago
- ☆49Updated last year
- [ICLR 2025] LongPO: Long Context Self-Evolution of Large Language Models through Short-to-Long Preference Optimization☆36Updated 3 months ago
- [ICML 2025] Programming Every Example: Lifting Pre-training Data Quality Like Experts at Scale☆248Updated 2 weeks ago