yuleiqin / fantastic-data-engineeringLinks
Fantastic Data Engineering for Large Language Models
☆90Updated 8 months ago
Alternatives and similar repositories for fantastic-data-engineering
Users that are interested in fantastic-data-engineering are comparing it to the libraries listed below
Sorting:
- [ICLR 2025] 🧬 RegMix: Data Mixture as Regression for Language Model Pre-training (Spotlight)☆168Updated 7 months ago
- [ACL'24] Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuning☆174Updated 2 months ago
- ☆83Updated last year
- [ACL-25] We introduce ScaleQuest, a scalable, novel and cost-effective data synthesis method to unleash the reasoning capability of LLMs.☆64Updated 10 months ago
- InsTag: A Tool for Data Analysis in LLM Supervised Fine-tuning☆272Updated 2 years ago
- The related works and background techniques about Openai o1☆222Updated 8 months ago
- [ACL 2024] The official codebase for the paper "Self-Distillation Bridges Distribution Gap in Language Model Fine-tuning".☆129Updated 10 months ago
- Benchmarking Complex Instruction-Following with Multiple Constraints Composition (NeurIPS 2024 Datasets and Benchmarks Track)☆92Updated 6 months ago
- ☆104Updated 2 months ago
- a-m-team's exploration in large language modeling☆187Updated 3 months ago
- Official implementation of the paper "From Complex to Simple: Enhancing Multi-Constraint Complex Instruction Following Ability of Large L…☆51Updated last year
- ☆145Updated last year
- The implementation of paper "LLM Critics Help Catch Bugs in Mathematics: Towards a Better Mathematical Verifier with Natural Language Fee…☆38Updated last year
- Collection of papers for scalable automated alignment.☆93Updated 10 months ago
- [ACL 2024] MT-Bench-101: A Fine-Grained Benchmark for Evaluating Large Language Models in Multi-Turn Dialogues☆112Updated last year
- ☆309Updated last year
- Code implementation of synthetic continued pretraining☆129Updated 8 months ago
- [ICML 2024] Selecting High-Quality Data for Training Language Models☆187Updated last year
- Model merging is a highly efficient approach for long-to-short reasoning.☆82Updated 3 months ago
- Official github repo for AutoDetect, an automated weakness detection framework for LLMs.☆42Updated last year
- A Comprehensive Survey on Long Context Language Modeling☆182Updated 2 months ago
- The demo, code and data of FollowRAG☆74Updated 2 months ago
- [COLING 2025] ToolEyes: Fine-Grained Evaluation for Tool Learning Capabilities of Large Language Models in Real-world Scenarios☆69Updated 4 months ago
- Llama-3-SynE: A Significantly Enhanced Version of Llama-3 with Advanced Scientific Reasoning and Chinese Language Capabilities | 继续预训练提升 …☆34Updated 3 months ago
- Clustering and Ranking: Diversity-preserved Instruction Selection through Expert-aligned Quality Estimation☆88Updated 10 months ago
- Counting-Stars (★)☆83Updated 3 months ago
- Codes and Data for Scaling Relationship on Learning Mathematical Reasoning with Large Language Models☆266Updated last year
- [EMNLP 2024] Source code for the paper "Learning Planning-based Reasoning with Trajectory Collection and Process Rewards Synthesizing".☆81Updated 8 months ago
- [ACL 2024] Long-Context Language Modeling with Parallel Encodings☆162Updated last year
- CFBench: A Comprehensive Constraints-Following Benchmark for LLMs☆42Updated last year