yuleiqin / fantastic-data-engineering
Fantastic Data Engineering for Large Language Models
☆87Updated 4 months ago
Alternatives and similar repositories for fantastic-data-engineering
Users that are interested in fantastic-data-engineering are comparing it to the libraries listed below
Sorting:
- [ICLR 2025] 🧬 RegMix: Data Mixture as Regression for Language Model Pre-training (Spotlight)☆135Updated 3 months ago
- Official implementation of the paper "From Complex to Simple: Enhancing Multi-Constraint Complex Instruction Following Ability of Large L…☆48Updated 10 months ago
- [ACL'24] Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuning☆151Updated 8 months ago
- [ICML 2024] Selecting High-Quality Data for Training Language Models☆171Updated 10 months ago
- Collection of papers for scalable automated alignment.☆89Updated 6 months ago
- [ACL 2024] The official codebase for the paper "Self-Distillation Bridges Distribution Gap in Language Model Fine-tuning".☆119Updated 6 months ago
- ☆98Updated 7 months ago
- ☆151Updated 5 months ago
- [EMNLP 2024] Source code for the paper "Learning Planning-based Reasoning with Trajectory Collection and Process Rewards Synthesizing".☆77Updated 4 months ago
- Code implementation of synthetic continued pretraining☆109Updated 4 months ago
- We introduce ScaleQuest, a scalable, novel and cost-effective data synthesis method to unleash the reasoning capability of LLMs.☆62Updated 6 months ago
- ☆81Updated last year
- A Comprehensive Survey on Long Context Language Modeling☆142Updated last month
- Official github repo for AutoDetect, an automated weakness detection framework for LLMs.☆42Updated 10 months ago
- Benchmarking Complex Instruction-Following with Multiple Constraints Composition (NeurIPS 2024 Datasets and Benchmarks Track)☆82Updated 2 months ago
- [ACL 2024] Long-Context Language Modeling with Parallel Encodings☆153Updated 11 months ago
- xVerify: Efficient Answer Verifier for Reasoning Model Evaluations☆96Updated last month
- We aim to provide the best references to search, select, and synthesize high-quality and large-quantity data for post-training your LLMs.☆55Updated 7 months ago
- The code and data of DPA-RAG, accepted by WWW 2025 main conference.☆61Updated 3 months ago
- Llama-3-SynE: A Significantly Enhanced Version of Llama-3 with Advanced Scientific Reasoning and Chinese Language Capabilities | 继续预训练提升 …☆32Updated 5 months ago
- [ICML'2024] Can AI Assistants Know What They Don't Know?☆80Updated last year
- The implementation of paper "LLM Critics Help Catch Bugs in Mathematics: Towards a Better Mathematical Verifier with Natural Language Fee…☆39Updated 9 months ago
- CLongEval: A Chinese Benchmark for Evaluating Long-Context Large Language Models☆40Updated last year
- [COLING 2025] ToolEyes: Fine-Grained Evaluation for Tool Learning Capabilities of Large Language Models in Real-world Scenarios☆66Updated this week
- a survey of long-context LLMs from four perspectives, architecture, infrastructure, training, and evaluation☆48Updated last month
- [ACL 2024] MT-Bench-101: A Fine-Grained Benchmark for Evaluating Large Language Models in Multi-Turn Dialogues☆86Updated 9 months ago
- Model merging is a highly efficient approach for long-to-short reasoning.☆46Updated last month
- Code and data for the paper "Can Large Language Models Understand Real-World Complex Instructions?"(AAAI2024)☆48Updated last year
- [EMNLP 2024 (Oral)] Leave No Document Behind: Benchmarking Long-Context LLMs with Extended Multi-Doc QA☆126Updated 6 months ago
- The related works and background techniques about Openai o1☆221Updated 4 months ago