RUCAIBox / awesome-llm-pretrainingLinks
Awesome LLM pre-training resources, including data, frameworks, and methods.
☆244Updated 4 months ago
Alternatives and similar repositories for awesome-llm-pretraining
Users that are interested in awesome-llm-pretraining are comparing it to the libraries listed below
Sorting:
- An Awesome List of Agentic Model trained with Reinforcement Learning☆461Updated last week
- Collect every awesome work about r1!☆416Updated 4 months ago
- A live reading list for LLM data synthesis (Updated to July, 2025).☆370Updated 2 weeks ago
- Harnessing the Reasoning Economy: A Survey of Efficient Reasoning for Large Language Models☆114Updated 3 months ago
- A visuailzation tool to make deep understaning and easier debugging for RLHF training.☆250Updated 6 months ago
- ☆163Updated 4 months ago
- [ACM Computing Surveys 2025] This repository collects awesome survey, resource, and paper for Lifelong Learning with Large Language Model…☆143Updated 3 months ago
- A Comprehensive Survey on Long Context Language Modeling☆182Updated 2 months ago
- A highly capable 2.4B lightweight LLM using only 1T pre-training data with all details.☆211Updated last month
- A lightweight reproduction of DeepSeek-R1-Zero with indepth analysis of self-reflection behavior.☆245Updated 5 months ago
- Trinity-RFT is a general-purpose, flexible and scalable framework designed for reinforcement fine-tuning (RFT) of large language models (…☆330Updated this week
- ☆125Updated last year
- ☆386Updated 2 weeks ago
- ☆741Updated last week
- A collection of 150+ surveys on LLMs☆325Updated 6 months ago
- R1-searcher: Incentivizing the Search Capability in LLMs via Reinforcement Learning☆630Updated last month
- ☆100Updated last year
- A Large-Scale, Challenging, Decontaminated, and Verifiable Mathematical Dataset for Advancing Reasoning☆250Updated 3 months ago
- ☆198Updated 5 months ago
- An up-to-date curated list of Retrieval-Augmented Generation (RAG) for LLMs.☆167Updated 3 weeks ago
- a-m-team's exploration in large language modeling☆187Updated 3 months ago
- The related works and background techniques about Openai o1☆224Updated 8 months ago
- OpenSeek aims to unite the global open source community to drive collaborative innovation in algorithms, data and systems to develop next…☆225Updated 2 weeks ago
- Awesome Agent Training☆223Updated last week
- Awesome Deep Research list! For more details, please refer to our survey paper -- A Comprehensive Survey of Deep Research: Systems, Metho…☆316Updated 2 weeks ago
- [ICML 2025] Programming Every Example: Lifting Pre-training Data Quality Like Experts at Scale☆262Updated 2 months ago
- Latest Advances on Long Chain-of-Thought Reasoning☆497Updated last month
- This is the reading list for the survey "A Survey on the Optimization of LLM-based Agents ". We will keep adding papers and improving the…☆153Updated 2 months ago
- a toolkit on knowledge distillation for large language models☆150Updated 2 weeks ago
- Awesome-Large-Search-Models is a collection of papers and resources (Methods, Datasets and other resources) about awesome agentic search …☆120Updated last week