RUCAIBox / awesome-llm-pretrainingLinks
Awesome LLM pre-training resources, including data, frameworks, and methods.
☆193Updated 2 months ago
Alternatives and similar repositories for awesome-llm-pretraining
Users that are interested in awesome-llm-pretraining are comparing it to the libraries listed below
Sorting:
- An Awesome List of Reinforcement Learning-based Large Language Agent Works. Collect directly from official code base.☆205Updated this week
- A visuailzation tool to make deep understaning and easier debugging for RLHF training.☆228Updated 4 months ago
- Collect every awesome work about r1!☆394Updated 2 months ago
- ☆154Updated 2 months ago
- A live reading list for LLM-synthetic-data.☆307Updated this week
- Harnessing the Reasoning Economy: A Survey of Efficient Reasoning for Large Language Models☆110Updated last month
- Scaling Deep Research via Reinforcement Learning in Real-world Environments.☆503Updated 3 months ago
- Awesome Deep Research list☆218Updated 2 weeks ago
- A highly capable 2.4B lightweight LLM using only 1T pre-training data with all details.☆195Updated last week
- This is a survey of research on AI scientists, AI researchers, AI engineers, and a series of AI-driven research studies☆76Updated last month
- [ACM Computing Surveys 2025] This repository collects awesome survey, resource, and paper for Lifelong Learning with Large Language Model…☆137Updated last month
- A Comprehensive Survey on Long Context Language Modeling☆161Updated this week
- This is the reading list for the survey "A Survey on the Optimization of LLM-based Agents ". We will keep adding papers and improving the…☆120Updated last week
- ☆99Updated last year
- ☆124Updated last year
- [COLM 2025] An Open Math Pre-trainng Dataset with 370B Tokens.☆95Updated 3 months ago
- ☆37Updated last month
- ☆270Updated last month
- A collection of 150+ surveys on LLMs☆312Updated 4 months ago
- a-m-team's exploration in large language modeling☆171Updated last month
- Awesome Agent Training☆179Updated this week
- Train a Language Model with GRPO to create a schedule from a list of events and priorities☆212Updated 2 months ago
- Ling is a MoE LLM provided and open-sourced by InclusionAI.☆175Updated last month
- ☆53Updated 4 months ago
- A lightweight reproduction of DeepSeek-R1-Zero with indepth analysis of self-reflection behavior.☆244Updated 2 months ago
- ☆193Updated 2 months ago
- R1-searcher: Incentivizing the Search Capability in LLMs via Reinforcement Learning☆588Updated last month
- Agentic RAG R1 Framework via Reinforcement Learning☆246Updated last month
- Reinforcement Learning in LLM and NLP.☆42Updated 3 weeks ago
- ☆162Updated 3 weeks ago