RUCAIBox / awesome-llm-pretrainingLinks
Awesome LLM pre-training resources, including data, frameworks, and methods.
☆212Updated 3 months ago
Alternatives and similar repositories for awesome-llm-pretraining
Users that are interested in awesome-llm-pretraining are comparing it to the libraries listed below
Sorting:
- An Awesome List of Reinforcement Learning-based Large Language Agent Works. Collect directly from official code base.☆234Updated 2 weeks ago
- Collect every awesome work about r1!☆397Updated 3 months ago
- Harnessing the Reasoning Economy: A Survey of Efficient Reasoning for Large Language Models☆112Updated last month
- A visuailzation tool to make deep understaning and easier debugging for RLHF training.☆238Updated 5 months ago
- This is a survey of research on AI scientists, AI researchers, AI engineers, and a series of AI-driven research studies☆80Updated 2 months ago
- [ACM Computing Surveys 2025] This repository collects awesome survey, resource, and paper for Lifelong Learning with Large Language Model…☆141Updated 2 months ago
- A highly capable 2.4B lightweight LLM using only 1T pre-training data with all details.☆200Updated last week
- A live reading list for LLM-synthetic-data.☆343Updated this week
- ☆157Updated 3 months ago
- Scaling Deep Research via Reinforcement Learning in Real-world Environments.☆532Updated 3 months ago
- A Comprehensive Survey on Long Context Language Modeling☆166Updated 3 weeks ago
- ☆173Updated last month
- Awesome Deep Research list☆262Updated last month
- ☆124Updated last year
- A collection of 150+ surveys on LLMs☆321Updated 5 months ago
- This is the reading list for the survey "A Survey on the Optimization of LLM-based Agents ". We will keep adding papers and improving the…☆132Updated 3 weeks ago
- ☆293Updated 2 months ago
- ☆734Updated 2 months ago
- Awesome Agent Training☆198Updated last week
- OpenSeek aims to unite the global open source community to drive collaborative innovation in algorithms, data and systems to develop next…☆217Updated last month
- Awesome-Large-Search-Models is a collection of papers and resources (Methods, Datasets and other resources) about awesome agentic search …☆110Updated last month
- Latest Advances on Long Chain-of-Thought Reasoning☆459Updated 2 weeks ago
- R1-searcher: Incentivizing the Search Capability in LLMs via Reinforcement Learning☆603Updated 2 months ago
- Generative AI Act II: Test Time Scaling Drives Cognition Engineering☆197Updated 3 months ago
- A lightweight reproduction of DeepSeek-R1-Zero with indepth analysis of self-reflection behavior.☆245Updated 3 months ago
- The official GitHub page for the survey paper "A Survey on Data Augmentation in Large Model Era"☆128Updated last year
- The development and future prospects of multimodal reasoning models.☆441Updated 2 weeks ago
- [ICML 2025] Programming Every Example: Lifting Pre-training Data Quality Like Experts at Scale☆255Updated 3 weeks ago
- ☆196Updated 3 months ago
- The related works and background techniques about Openai o1☆224Updated 6 months ago