QwenLM / online_merging_optimizers
Implementations of online merging optimizers proposed by Online Merging Optimizers for Boosting Rewards and Mitigating Tax in Alignment
ā73Updated 8 months ago
Alternatives and similar repositories for online_merging_optimizers:
Users that are interested in online_merging_optimizers are comparing it to the libraries listed below
- ā95Updated 4 months ago
- [ICLR 2025] š§¬ RegMix: Data Mixture as Regression for Language Model Pre-training (Spotlight)ā106Updated this week
- Benchmarking Complex Instruction-Following with Multiple Constraints Composition (NeurIPS 2024 Datasets and Benchmarks Track)ā64Updated this week
- Official repository for paper "Weak-to-Strong Extrapolation Expedites Alignment"ā72Updated 8 months ago
- Official implementation of the paper "From Complex to Simple: Enhancing Multi-Constraint Complex Instruction Following Ability of Large Lā¦ā44Updated 7 months ago
- [ICLR 2024] CLEX: Continuous Length Extrapolation for Large Language Modelsā76Updated 11 months ago
- An Experiment on Dynamic NTK Scaling RoPEā62Updated last year
- Source code of "Reasons to Reject? Aligning Language Models with Judgments"ā58Updated 11 months ago
- [COLING 2025] ToolEyes: Fine-Grained Evaluation for Tool Learning Capabilities of Large Language Models in Real-world Scenariosā65Updated 2 months ago
- [ACL 2024] MT-Bench-101: A Fine-Grained Benchmark for Evaluating Large Language Models in Multi-Turn Dialoguesā68Updated 6 months ago
- CLongEval: A Chinese Benchmark for Evaluating Long-Context Large Language Modelsā38Updated 11 months ago
- Reformatted Alignmentā114Updated 4 months ago
- Code implementation of synthetic continued pretrainingā88Updated last month
- We introduce ScaleQuest, a scalable, novel and cost-effective data synthesis method to unleash the reasoning capability of LLMs.ā60Updated 3 months ago
- Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]ā135Updated 3 months ago
- [ICML 2024] Selecting High-Quality Data for Training Language Modelsā157Updated 8 months ago
- ā48Updated 11 months ago
- ā45Updated 8 months ago
- Collection of papers for scalable automated alignment.ā82Updated 3 months ago
- [ICLR'24 spotlight] Tool-Augmented Reward Modelingā44Updated last month
- [ACL'24] Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuningā142Updated 5 months ago
- Towards Systematic Measurement for Long Text Qualityā31Updated 5 months ago
- code for Scaling Laws of RoPE-based Extrapolationā70Updated last year
- Code for ACL2023 paper: Pre-Training to Learn in Contextā108Updated 6 months ago
- Intuitive Fine-Tuning: Towards Simplifying Alignment into a Single Processā25Updated 6 months ago
- Llama-3-SynE: A Significantly Enhanced Version of Llama-3 with Advanced Scientific Reasoning and Chinese Language Capabilities | ē»§ē»é¢č®ē»ęå ā¦ā33Updated 2 months ago
- ā66Updated 11 months ago
- [ACL 2024] FollowBench: A Multi-level Fine-grained Constraints Following Benchmark for Large Language Modelsā96Updated 2 months ago
- ā130Updated 2 months ago