RUC-GSAI / YuLan-Mini
A highly capable 2.4B lightweight LLM using only 1T pre-training data with all details.
☆170Updated this week
Alternatives and similar repositories for YuLan-Mini:
Users that are interested in YuLan-Mini are comparing it to the libraries listed below
- ☆61Updated 4 months ago
- A Comprehensive Survey on Long Context Language Modeling☆126Updated 2 weeks ago
- L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning☆175Updated 3 weeks ago
- ☆272Updated 3 weeks ago
- Offical Repo for "Programming Every Example: Lifting Pre-training Data Quality Like Experts at Scale"☆234Updated last month
- Exploring the Limit of Outcome Reward for Learning Mathematical Reasoning☆166Updated 3 weeks ago
- Curation of resources for LLM mathematical reasoning, most of which are screened by @tongyx361 to ensure high quality and accompanied wit…☆123Updated 9 months ago
- ☆182Updated last month
- A lightweight reproduction of DeepSeek-R1-Zero with indepth analysis of self-reflection behavior.☆218Updated last week
- This is a repo for showcasing using MCTS with LLMs to solve gsm8k problems☆69Updated 3 weeks ago
- Research Code for preprint "Optimizing Test-Time Compute via Meta Reinforcement Finetuning".☆89Updated last month
- ☆265Updated 8 months ago
- Fantastic Data Engineering for Large Language Models☆87Updated 3 months ago
- Homepage for ProLong (Princeton long-context language models) and paper "How to Train Long-Context Language Models (Effectively)"☆174Updated last month
- Rethinking RL Scaling for Vision Language Models: A Transparent, From-Scratch Framework and Comprehensive Evaluation Scheme☆54Updated last week
- Advancing Language Model Reasoning through Reinforcement Learning and Inference Scaling☆99Updated 2 months ago
- [EMNLP 2024] LongAlign: A Recipe for Long Context Alignment of LLMs☆249Updated 3 months ago
- OpenSeek aims to unite the global open source community to drive collaborative innovation in algorithms, data and systems to develop next…☆130Updated 3 weeks ago
- ☆101Updated 4 months ago
- ☆99Updated last week
- A simple toolkit for benchmarking LLMs on mathematical reasoning tasks. 🧮✨☆196Updated 11 months ago
- The official repository of the Omni-MATH benchmark.☆79Updated 3 months ago
- OpenRFT: Adapting Reasoning Foundation Model for Domain-specific Tasks with Reinforcement Fine-Tuning☆128Updated 3 months ago
- The demo, code and data of FollowRAG☆71Updated 4 months ago
- Code for "Critique Fine-Tuning: Learning to Critique is More Effective than Learning to Imitate"☆133Updated 2 months ago
- [EMNLP 2024 (Oral)] Leave No Document Behind: Benchmarking Long-Context LLMs with Extended Multi-Doc QA☆122Updated 5 months ago
- A visuailzation tool to make deep understaning and easier debugging for RLHF training.☆186Updated last month
- ☆148Updated last month
- ☆134Updated last month
- Repo of paper "Free Process Rewards without Process Labels"☆140Updated last month