hamishivi / automated-instruction-selection
Exploration of automated dataset selection approaches at large scales.
☆39Updated last month
Alternatives and similar repositories for automated-instruction-selection:
Users that are interested in automated-instruction-selection are comparing it to the libraries listed below
- ☆31Updated 3 months ago
- Codebase for Instruction Following without Instruction Tuning☆34Updated 7 months ago
- The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling☆29Updated last month
- Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"☆47Updated last year
- The repository contains code for Adaptive Data Optimization☆23Updated 4 months ago
- ☆18Updated 9 months ago
- Code for ICLR 2025 Paper "What is Wrong with Perplexity for Long-context Language Modeling?"☆53Updated 3 weeks ago
- This is an official implementation of the Reward rAnked Fine-Tuning Algorithm (RAFT), also known as iterative best-of-n fine-tuning or re…☆29Updated 7 months ago
- DuoGuard: A Two-Player RL-Driven Framework for Multilingual LLM Guardrails☆20Updated last month
- ☆64Updated last year
- Benchmarking Benchmark Leakage in Large Language Models☆51Updated 11 months ago
- ☆23Updated 2 months ago
- ☆46Updated last month
- ☆20Updated 2 months ago
- [NeurIPS-2024] 📈 Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies https://arxiv.org/abs/2407.13623☆82Updated 6 months ago
- ☆17Updated 3 months ago
- Stanford NLP Python library for benchmarking the utility of LLM interpretability methods☆70Updated 3 weeks ago
- Long Context Extension and Generalization in LLMs☆53Updated 7 months ago
- Is In-Context Learning Sufficient for Instruction Following in LLMs? [ICLR 2025]☆29Updated 3 months ago
- A Large-Scale, High-Quality Math Dataset for Reinforcement Learning in Language Models☆47Updated last month
- Replicating O1 inference-time scaling laws☆83Updated 4 months ago
- Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"☆26Updated last year
- Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"☆71Updated 5 months ago
- This is the oficial repository for "Safer-Instruct: Aligning Language Models with Automated Preference Data"☆17Updated last year
- NeurIPS 2024 tutorial on LLM Inference☆41Updated 4 months ago
- Directional Preference Alignment☆57Updated 7 months ago
- Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model☆45Updated last year
- Official repository for paper "Weak-to-Strong Extrapolation Expedites Alignment"☆74Updated 10 months ago
- ☆27Updated 9 months ago
- Organize the Web: Constructing Domains Enhances Pre-Training Data Curation☆42Updated 2 months ago