feiyang-k / AutoScaleLinks
Official Code Repository for [AutoScaleπ: Scale-Aware Data Mixing for Pre-Training LLMs] Published as a conference paper at **COLM 2025**
β13Updated 6 months ago
Alternatives and similar repositories for AutoScale
Users that are interested in AutoScale are comparing it to the libraries listed below
Sorting:
- β13Updated last year
- The official repository of "Improving Large Language Models via Fine-grained Reinforcement Learning with Minimum Editing Constraint"β39Updated 2 years ago
- β58Updated last year
- [NAACL 2025] The official implementation of paper "Learning From Failure: Integrating Negative Examples when Fine-tuning Large Language Mβ¦β28Updated last year
- β15Updated last year
- Code for the 2025 ACL publication "Fine-Tuning on Diverse Reasoning Chains Drives Within-Inference CoT Refinement in LLMs"β33Updated 7 months ago
- Official implementation of the paper "From Complex to Simple: Enhancing Multi-Constraint Complex Instruction Following Ability of Large Lβ¦β53Updated last year
- Source code of "Reasons to Reject? Aligning Language Models with Judgments"β58Updated last year
- An implementation of online data mixing for the Pile dataset, based on the GPT-NeoX library.β13Updated 2 years ago
- [ACL 2024] Code for the paper "ALaRM: Align Language Models via Hierarchical Rewards Modeling"β25Updated last year
- Watch Every Step! LLM Agent Learning via Iterative Step-level Process Refinement (EMNLP 2024 Main Conference)β65Updated last year
- This the implementation of LeCoβ31Updated last year
- Trending projects & awesome papers about data-centric llm studies.β39Updated 8 months ago
- β30Updated last year
- Codebase for Instruction Following without Instruction Tuningβ36Updated last year
- [ICML'2024] Can AI Assistants Know What They Don't Know?β85Updated 2 years ago
- RAG-RewardBench: Benchmarking Reward Models in Retrieval Augmented Generation for Preference Alignmentβ16Updated last year
- Towards Systematic Measurement for Long Text Qualityβ37Updated last year
- The Good, The Bad, and The Greedy: Evaluation of LLMs Should Not Ignore Non-Determinismβ30Updated last year
- [NAACL 2024 Outstanding Paper] Source code for the NAACL 2024 paper entitled "R-Tuning: Instructing Large Language Models to Say 'I Don'tβ¦β129Updated last year
- Official code for Guiding Language Model Math Reasoning with Planning Tokensβ18Updated last year
- β34Updated last year
- Official code implementation for the ACL 2025 paper: 'CoT-based Synthesizer: Enhancing LLM Performance through Answer Synthesis'β32Updated 8 months ago
- β109Updated 6 months ago
- Official repository for MATES: Model-Aware Data Selection for Efficient Pretraining with Data Influence Models [NeurIPS 2024]β79Updated last year
- [AAAI 2025 oral] Evaluating Mathematical Reasoning Beyond Accuracyβ77Updated 4 months ago
- [EMNLP 2024] Source code for the paper "Learning Planning-based Reasoning with Trajectory Collection and Process Rewards Synthesizing".β83Updated last year
- The rule-based evaluation subset and code implementation of Omni-MATHβ26Updated last year
- β16Updated 8 months ago
- [ACL 2025] We introduce ScaleQuest, a scalable, novel and cost-effective data synthesis method to unleash the reasoning capability of LLMβ¦β68Updated last year