hamishivi / automated-instruction-selection
Exploration of automated dataset selection approaches at large scales.
☆40Updated 2 months ago
Alternatives and similar repositories for automated-instruction-selection
Users that are interested in automated-instruction-selection are comparing it to the libraries listed below
Sorting:
- Revisiting Mid-training in the Era of RL Scaling☆37Updated 3 weeks ago
- Codebase for Instruction Following without Instruction Tuning☆34Updated 7 months ago
- Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"☆47Updated last year
- The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling☆29Updated last month
- ☆31Updated 4 months ago
- A Large-Scale, High-Quality Math Dataset for Reinforcement Learning in Language Models☆52Updated 2 months ago
- [NeurIPS 2024 Main Track] Code for the paper titled "Instruction Tuning With Loss Over Instructions"☆36Updated 11 months ago
- ☆46Updated 2 months ago
- ☆16Updated 9 months ago
- ☆64Updated last year
- Official Repository of Are Your LLMs Capable of Stable Reasoning?☆25Updated last month
- Long Context Extension and Generalization in LLMs☆54Updated 7 months ago
- Replicating O1 inference-time scaling laws☆85Updated 5 months ago
- Is In-Context Learning Sufficient for Instruction Following in LLMs? [ICLR 2025]☆30Updated 3 months ago
- ☆17Updated 4 months ago
- Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model☆44Updated last year
- [NeurIPS-2024] 📈 Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies https://arxiv.org/abs/2407.13623☆84Updated 7 months ago
- This is an official implementation of the Reward rAnked Fine-Tuning Algorithm (RAFT), also known as iterative best-of-n fine-tuning or re…☆29Updated 7 months ago
- [NAACL 2025] A Closer Look into Mixture-of-Experts in Large Language Models☆51Updated 3 months ago
- Unofficial Implementation of Chain-of-Thought Reasoning Without Prompting☆32Updated last year
- Code for ICLR 2025 Paper "What is Wrong with Perplexity for Long-context Language Modeling?"☆72Updated last month
- Benchmarking Benchmark Leakage in Large Language Models☆51Updated 11 months ago
- The repository contains code for Adaptive Data Optimization☆24Updated 5 months ago
- Official implementation of Bootstrapping Language Models via DPO Implicit Rewards☆44Updated last month
- [ICLR'24 spotlight] Tool-Augmented Reward Modeling☆47Updated 4 months ago
- DuoGuard: A Two-Player RL-Driven Framework for Multilingual LLM Guardrails☆21Updated 2 months ago
- ☆16Updated last month
- Official repository of "LiNeS: Post-training Layer Scaling Prevents Forgetting and Enhances Model Merging"☆26Updated 6 months ago
- Official repository for paper "Weak-to-Strong Extrapolation Expedites Alignment"☆74Updated 11 months ago
- Organize the Web: Constructing Domains Enhances Pre-Training Data Curation☆47Updated last week