microsoft / RedStoneLinks
The RedStone repository includes code for preparing extensive datasets used in training large language models.
☆137Updated last month
Alternatives and similar repositories for RedStone
Users that are interested in RedStone are comparing it to the libraries listed below
Sorting:
- [ICML 2025] Programming Every Example: Lifting Pre-training Data Quality Like Experts at Scale☆255Updated last month
- ☆90Updated 2 months ago
- Ling is a MoE LLM provided and open-sourced by InclusionAI.☆181Updated 2 months ago
- ☆288Updated 2 months ago
- Mixture-of-Experts (MoE) Language Model☆189Updated 11 months ago
- ☆157Updated 3 months ago
- ☆320Updated 10 months ago
- Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models☆136Updated last year
- [ACL 2025] An official pytorch implement of the paper: Condor: Enhance LLM Alignment with Knowledge-Driven Data Synthesis and Refinement☆32Updated 2 months ago
- [COLM 2025] An Open Math Pre-trainng Dataset with 370B Tokens.☆96Updated 4 months ago
- Reformatted Alignment☆113Updated 10 months ago
- Trinity-RFT is a general-purpose, flexible and scalable framework designed for reinforcement fine-tuning (RFT) of large language models (…☆204Updated this week
- ☆186Updated 4 months ago
- Implementation of the LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens Paper☆146Updated last year
- ☆88Updated this week
- ☆144Updated last year
- ☆87Updated 2 months ago
- DeepResearch Bench: A Comprehensive Benchmark for Deep Research Agents☆245Updated this week
- Implementation for OAgents: An Empirical Study of Building Effective Agents☆101Updated last week
- [EMNLP 2024] LongAlign: A Recipe for Long Context Alignment of LLMs☆253Updated 7 months ago
- [ACL 2024] LLM2LLM: Boosting LLMs with Novel Iterative Data Enhancement☆187Updated last year
- ☆301Updated last year
- ☆95Updated 7 months ago
- Scaling Preference Data Curation via Human-AI Synergy☆95Updated last month
- An automated pipeline for evaluating LLMs for role-playing.☆195Updated 10 months ago
- [ICML 2025] |TokenSwift: Lossless Acceleration of Ultra Long Sequence Generation☆111Updated 2 months ago
- A framework to study AI models in Reasoning, Alignment, and use of Memory (RAM).☆265Updated 2 weeks ago
- [ICLR 2025] The official implementation of paper "ToolGen: Unified Tool Retrieval and Calling via Generation"☆156Updated 4 months ago
- ☆103Updated 8 months ago
- code for Scaling Laws of RoPE-based Extrapolation☆73Updated last year