microsoft / RedStoneLinks
The RedStone repository includes code for preparing extensive datasets used in training large language models.
☆140Updated 2 months ago
Alternatives and similar repositories for RedStone
Users that are interested in RedStone are comparing it to the libraries listed below
Sorting:
- [ICML 2025] Programming Every Example: Lifting Pre-training Data Quality Like Experts at Scale☆258Updated last month
- ☆90Updated 3 months ago
- ☆161Updated 4 months ago
- ☆293Updated 3 months ago
- Mixture-of-Experts (MoE) Language Model☆189Updated 11 months ago
- Ling is a MoE LLM provided and open-sourced by InclusionAI.☆187Updated 3 months ago
- ☆320Updated 11 months ago
- [ICML 2025] |TokenSwift: Lossless Acceleration of Ultra Long Sequence Generation☆113Updated 3 months ago
- Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models☆136Updated last year
- Scaling Preference Data Curation via Human-AI Synergy☆100Updated last month
- Reformatted Alignment☆113Updated 11 months ago
- Implementation for OAgents: An Empirical Study of Building Effective Agents☆242Updated this week
- ☆305Updated last year
- [COLM 2025] An Open Math Pre-trainng Dataset with 370B Tokens.☆100Updated 4 months ago
- ☆96Updated 3 months ago
- ☆103Updated 8 months ago
- [ACL 2025] An official pytorch implement of the paper: Condor: Enhance LLM Alignment with Knowledge-Driven Data Synthesis and Refinement☆34Updated 3 months ago
- ☆94Updated 8 months ago
- code for Scaling Laws of RoPE-based Extrapolation☆73Updated last year
- ☆65Updated 9 months ago
- ☆50Updated last year
- A highly capable 2.4B lightweight LLM using only 1T pre-training data with all details.☆209Updated last month
- ☆96Updated 8 months ago
- [ACL 2024 Demo] Official GitHub repo for UltraEval: An open source framework for evaluating foundation models.☆247Updated 10 months ago
- ☆191Updated 4 months ago
- [ACL 2024] LLM2LLM: Boosting LLMs with Novel Iterative Data Enhancement☆189Updated last year
- Efficient Agent Training for Computer Use☆125Updated 2 months ago
- ☆74Updated 2 weeks ago
- ☆146Updated last year
- Exploring the Limit of Outcome Reward for Learning Mathematical Reasoning☆190Updated 5 months ago