microsoft / RedStoneLinks
The RedStone repository includes code for preparing extensive datasets used in training large language models.
☆135Updated 2 weeks ago
Alternatives and similar repositories for RedStone
Users that are interested in RedStone are comparing it to the libraries listed below
Sorting:
- ☆86Updated last month
- [ICML 2025] Programming Every Example: Lifting Pre-training Data Quality Like Experts at Scale☆251Updated 3 weeks ago
- An Open Math Pre-trainng Dataset with 370B Tokens.☆89Updated 2 months ago
- ☆152Updated last month
- DeepResearch Bench: A Comprehensive Benchmark for Deep Research Agents☆135Updated last week
- ☆291Updated 11 months ago
- InsTag: A Tool for Data Analysis in LLM Supervised Fine-tuning☆261Updated last year
- [ICLR 2025] The official implementation of paper "ToolGen: Unified Tool Retrieval and Calling via Generation"☆145Updated 3 months ago
- AutoCoA (Automatic generation of Chain-of-Action) is an agent model framework that enhances the multi-turn tool usage capability of reaso…☆116Updated 3 months ago
- Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models☆133Updated last year
- A visuailzation tool to make deep understaning and easier debugging for RLHF training.☆216Updated 4 months ago
- [ACL 2025] An official pytorch implement of the paper: Condor: Enhance LLM Alignment with Knowledge-Driven Data Synthesis and Refinement☆30Updated 3 weeks ago
- Ling is a MoE LLM provided and open-sourced by InclusionAI.☆170Updated last month
- ☆145Updated 5 months ago
- ☆273Updated 3 weeks ago
- On Memorization of Large Language Models in Logical Reasoning☆67Updated 2 months ago
- A lightweight reproduction of DeepSeek-R1-Zero with indepth analysis of self-reflection behavior.☆241Updated 2 months ago
- ☆103Updated 6 months ago
- ☆241Updated 2 weeks ago
- A Comprehensive Survey on Long Context Language Modeling☆152Updated 3 weeks ago
- ☆142Updated 11 months ago
- [ACL'24] Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuning☆160Updated this week
- ☆95Updated 6 months ago
- [EMNLP 2024] LongAlign: A Recipe for Long Context Alignment of LLMs☆250Updated 6 months ago
- Scaling Deep Research via Reinforcement Learning in Real-world Environments.☆461Updated 2 months ago
- code for Scaling Laws of RoPE-based Extrapolation☆73Updated last year
- [ICML 2025] |TokenSwift: Lossless Acceleration of Ultra Long Sequence Generation☆105Updated last month
- ☆169Updated last year
- Implementations of online merging optimizers proposed by Online Merging Optimizers for Boosting Rewards and Mitigating Tax in Alignment☆75Updated last year
- [ACL 2024 Demo] Official GitHub repo for UltraEval: An open source framework for evaluating foundation models.☆244Updated 7 months ago