RUCAIBox / awesome-llm-pretrainingLinks
Awesome LLM pre-training resources, including data, frameworks, and methods.
☆180Updated last month
Alternatives and similar repositories for awesome-llm-pretraining
Users that are interested in awesome-llm-pretraining are comparing it to the libraries listed below
Sorting:
- An Awesome List of Reinforcement Learning-based Large Language Agent Works. Collect directly from official code base.☆93Updated this week
- Collect every awesome work about r1!☆386Updated last month
- A visuailzation tool to make deep understaning and easier debugging for RLHF training.☆213Updated 4 months ago
- ☆233Updated last month
- ☆152Updated last month
- Harnessing the Reasoning Economy: A Survey of Efficient Reasoning for Large Language Models☆108Updated 2 weeks ago
- This is a survey of research on AI scientists, AI researchers, AI engineers, and a series of AI-driven research studies☆68Updated last month
- Real-time updated, fine-grained reading list on LLM-synthetic-data.🔥☆262Updated 4 months ago
- A lightweight reproduction of DeepSeek-R1-Zero with indepth analysis of self-reflection behavior.☆240Updated 2 months ago
- This is the reading list for the survey "A Survey on the Optimization of LLM-based Agents ". We will keep adding papers and improving the…☆111Updated last month
- A Comprehensive Survey on Long Context Language Modeling☆151Updated 2 weeks ago
- [ICML 2025] Programming Every Example: Lifting Pre-training Data Quality Like Experts at Scale☆251Updated 2 weeks ago
- ☆100Updated last year
- Scaling Deep Research via Reinforcement Learning in Real-world Environments.☆450Updated 2 months ago
- ☆54Updated 7 months ago
- Awesome Agent Training☆157Updated 2 weeks ago
- Train a Language Model with GRPO to create a schedule from a list of events and priorities☆204Updated last month
- An Open Math Pre-trainng Dataset with 370B Tokens.☆89Updated 2 months ago
- [ACM Computing Surveys 2025] This repository collects awesome survey, resource, and paper for Lifelong Learning with Large Language Model…☆133Updated 3 weeks ago
- ☆53Updated 3 months ago
- ☆231Updated last week
- ☆124Updated last year
- A highly capable 2.4B lightweight LLM using only 1T pre-training data with all details.☆189Updated 2 weeks ago
- IKEA: Reinforced Internal-External Knowledge Synergistic Reasoning for Efficient Adaptive Search Agent☆57Updated last month
- Repo for "MaskSearch: A Universal Pre-Training Framework to Enhance Agentic Search Capability"☆122Updated 3 weeks ago
- ☆418Updated this week
- Exploring the Limit of Outcome Reward for Learning Mathematical Reasoning☆186Updated 3 months ago
- R1-searcher: Incentivizing the Search Capability in LLMs via Reinforcement Learning☆561Updated 3 weeks ago
- The development and future prospects of multimodal reasoning models.☆384Updated last week
- ☆220Updated 3 weeks ago