RUCAIBox / awesome-llm-pretrainingLinks
Awesome LLM pre-training resources, including data, frameworks, and methods.
☆260Updated 5 months ago
Alternatives and similar repositories for awesome-llm-pretraining
Users that are interested in awesome-llm-pretraining are comparing it to the libraries listed below
Sorting:
- An Awesome List of Agentic Model trained with Reinforcement Learning☆483Updated 2 weeks ago
- Collect every awesome work about r1!☆417Updated 5 months ago
- A live reading list for LLM data synthesis (Updated to July, 2025).☆378Updated last month
- A Comprehensive Survey on Long Context Language Modeling☆189Updated 2 months ago
- A visuailzation tool to make deep understaning and easier debugging for RLHF training.☆256Updated 7 months ago
- ☆169Updated 5 months ago
- Harnessing the Reasoning Economy: A Survey of Efficient Reasoning for Large Language Models☆117Updated 3 months ago
- ☆125Updated last year
- Trinity-RFT is a general-purpose, flexible and scalable framework designed for reinforcement fine-tuning (RFT) of large language models (…☆356Updated last week
- a-m-team's exploration in large language modeling☆188Updated 4 months ago
- ☆406Updated last month
- A highly capable 2.4B lightweight LLM using only 1T pre-training data with all details.☆217Updated 2 months ago
- A lightweight reproduction of DeepSeek-R1-Zero with indepth analysis of self-reflection behavior.☆244Updated 5 months ago
- This is the reading list for the survey "A Survey on the Optimization of LLM-based Agents ". We will keep adding papers and improving the…☆160Updated 3 months ago
- [COLM 2025] An Open Math Pre-trainng Dataset with 370B Tokens.☆100Updated 6 months ago
- [ICML 2025] Programming Every Example: Lifting Pre-training Data Quality Like Experts at Scale☆263Updated 2 months ago
- Reinforcement Learning in LLM and NLP.☆60Updated 3 weeks ago
- [ACM Computing Surveys 2025] This repository collects awesome survey, resource, and paper for Lifelong Learning with Large Language Model…☆147Updated 4 months ago
- The related works and background techniques about Openai o1☆222Updated 8 months ago
- ☆743Updated last month
- Ling is a MoE LLM provided and open-sourced by InclusionAI.☆203Updated 4 months ago
- Awesome Deep Research list! For more details, please refer to our survey paper -- A Comprehensive Survey of Deep Research: Systems, Metho…☆330Updated last month
- Awesome Agent Training☆231Updated last month
- Generative AI Act II: Test Time Scaling Drives Cognition Engineering☆206Updated 5 months ago
- Scaling Deep Research via Reinforcement Learning in Real-world Environments.☆610Updated 5 months ago
- ☆101Updated last year
- a toolkit on knowledge distillation for large language models☆162Updated 3 weeks ago
- MiroRL is an MCP-first reinforcement learning framework for deep research agent.☆162Updated last month
- ☆352Updated 3 months ago
- ☆202Updated 5 months ago