RUCAIBox / awesome-llm-pretrainingLinks
Awesome LLM pre-training resources, including data, frameworks, and methods.
☆289Updated 7 months ago
Alternatives and similar repositories for awesome-llm-pretraining
Users that are interested in awesome-llm-pretraining are comparing it to the libraries listed below
Sorting:
- Awesome List for Agentic RL☆571Updated last week
- Collect every awesome work about r1!☆423Updated 7 months ago
- Harnessing the Reasoning Economy: A Survey of Efficient Reasoning for Large Language Models☆120Updated last month
- A visuailzation tool to make deep understaning and easier debugging for RLHF training.☆271Updated 9 months ago
- A live reading list for LLM data synthesis (Updated to July, 2025).☆420Updated 3 months ago
- Trinity-RFT is a general-purpose, flexible and scalable framework designed for reinforcement fine-tuning (RFT) of large language models (…☆422Updated this week
- ☆173Updated 7 months ago
- [ACM Computing Surveys 2025] This repository collects awesome survey, resource, and paper for Lifelong Learning with Large Language Model…☆157Updated 6 months ago
- A Comprehensive Survey on Long Context Language Modeling☆209Updated 2 weeks ago
- A highly capable 2.4B lightweight LLM using only 1T pre-training data with all details.☆221Updated 4 months ago
- ☆751Updated 3 months ago
- ☆438Updated last month
- a-m-team's exploration in large language modeling☆194Updated 6 months ago
- A Large-Scale, Challenging, Decontaminated, and Verifiable Mathematical Dataset for Advancing Reasoning☆279Updated 2 months ago
- OpenSeek aims to unite the global open source community to drive collaborative innovation in algorithms, data and systems to develop next…☆240Updated 3 weeks ago
- The related works and background techniques about Openai o1☆221Updated 11 months ago
- R1-searcher: Incentivizing the Search Capability in LLMs via Reinforcement Learning☆659Updated 4 months ago
- A lightweight reproduction of DeepSeek-R1-Zero with indepth analysis of self-reflection behavior.☆248Updated 7 months ago
- Scaling Deep Research via Reinforcement Learning in Real-world Environments.☆666Updated last month
- [ICML 2025] Programming Every Example: Lifting Pre-training Data Quality Like Experts at Scale☆263Updated 5 months ago
- ☆207Updated last month
- Generative AI Act II: Test Time Scaling Drives Cognition Engineering☆209Updated 7 months ago
- ☆125Updated last year
- Reinforcement Learning in LLM and NLP.☆61Updated 2 months ago
- A version of verl to support diverse tool use☆722Updated last week
- ☆390Updated last month
- A collection of 150+ surveys on LLMs☆342Updated 9 months ago
- [TMLR 2025] Stop Overthinking: A Survey on Efficient Reasoning for Large Language Models☆701Updated last month
- ☆213Updated 9 months ago
- A series of technical report on Slow Thinking with LLM☆751Updated 3 months ago