locuslab / scaling_laws_data_filtering
β64Updated 11 months ago
Alternatives and similar repositories for scaling_laws_data_filtering:
Users that are interested in scaling_laws_data_filtering are comparing it to the libraries listed below
- [NeurIPS-2024] π Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies https://arxiv.org/abs/2407.13623β80Updated 5 months ago
- Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"β46Updated last year
- Codebase for Instruction Following without Instruction Tuningβ33Updated 6 months ago
- Code for preprint "Metadata Conditioning Accelerates Language Model Pre-training (MeCo)"β36Updated this week
- Code for ICLR 2025 Paper "What is Wrong with Perplexity for Long-context Language Modeling?"β44Updated last month
- [NAACL 2025] A Closer Look into Mixture-of-Experts in Large Language Modelsβ45Updated last month
- β15Updated 8 months ago
- [NeurIPS 2024 Main Track] Code for the paper titled "Instruction Tuning With Loss Over Instructions"β35Updated 10 months ago
- Reproduction of "RLCD Reinforcement Learning from Contrast Distillation for Language Model Alignmentβ66Updated last year
- Long Context Extension and Generalization in LLMsβ50Updated 6 months ago
- β98Updated 5 months ago
- [NAACL 2025] Source code for MMEvalPro, a more trustworthy and efficient benchmark for evaluating LMMsβ23Updated 5 months ago
- SLED: Self Logits Evolution Decoding for Improving Factuality in Large Language Model https://arxiv.org/pdf/2411.02433β24Updated 3 months ago
- Source code of "Reasons to Reject? Aligning Language Models with Judgments"β58Updated last year
- [ICLR'24 spotlight] Tool-Augmented Reward Modelingβ45Updated 2 months ago
- The code and data for the paper JiuZhang3.0β42Updated 9 months ago
- β20Updated 4 months ago
- Official repository for MATES: Model-Aware Data Selection for Efficient Pretraining with Data Influence Models [NeurIPS 2024]β61Updated 4 months ago
- [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswalβ¦β48Updated 2 years ago
- A simple GPT-based evaluation tool for multi-aspect, interpretable assessment of LLMs.β84Updated last year
- [ICLR 2024] CLEX: Continuous Length Extrapolation for Large Language Modelsβ76Updated last year
- Automatic prompt optimization framework for multi-step agent tasks.β28Updated 4 months ago
- This is the oficial repository for "Safer-Instruct: Aligning Language Models with Automated Preference Data"β17Updated last year
- β59Updated 6 months ago
- Official github repo for the paper "Compression Represents Intelligence Linearly" [COLM 2024]β130Updated 6 months ago