Our code for ICLR'25 paper "DataMan: Data Manager for Pre-training Large Language Models".
☆124Feb 7, 2026Updated 3 months ago
Alternatives and similar repositories for DataMan
Users that are interested in DataMan are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Our code for ICLR'24 paper "Energy-based Automated Model Evaluation".☆24Feb 13, 2025Updated last year
- A live reading list for LLM data synthesis (Updated to July, 2025).☆481Apr 9, 2026Updated last month
- This is the official implementation of our ACL 2025 Main paper "Balancing Diversity and Risk in LLM Sampling".☆17Oct 16, 2025Updated 7 months ago
- LCA-on-the-line (ICML 2024 Oral)☆14Feb 13, 2025Updated last year
- Research work aimed at addressing the problem of modeling infinite-length context☆48Dec 18, 2025Updated 5 months ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- The source code for paper:Two-level Consistency Metric for Infrared and Visible Image Fusion☆11Jun 30, 2023Updated 2 years ago
- Code Implementation, Evaluations, Documentation, Links and Resources for Min P paper☆48Aug 13, 2025Updated 9 months ago
- [ACL 2025] An official pytorch implement of the paper: Condor: Enhance LLM Alignment with Knowledge-Driven Data Synthesis and Refinement☆40May 28, 2025Updated last year
- ☆17Nov 29, 2023Updated 2 years ago
- [ICML 2024] Selecting High-Quality Data for Training Language Models☆203Dec 8, 2025Updated 5 months ago
- Dataflow-MM, multi-media operators for Dataflow. We aim to prepare data for Multimodal Large Language Models.☆40Apr 13, 2026Updated last month
- ☆36Jul 7, 2025Updated 10 months ago
- ☆98Nov 6, 2024Updated last year
- CoT-Valve: Length-Compressible Chain-of-Thought Tuning☆92Feb 14, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- SEED: Self-supervised Distillation for Visual Representation☆16Jul 20, 2022Updated 3 years ago
- [ICLR 2025] Pad: Personalized alignment of llms at decoding-time☆20Mar 19, 2025Updated last year
- AdaptiveStep: Automatically Dividing Reasoning Step through Model Confidence☆10Mar 2, 2025Updated last year
- ☆21Jul 3, 2025Updated 10 months ago
- MAP: Low-compute Model Merging with Amortized Pareto Fronts via Quadratic Approximation☆17Sep 2, 2024Updated last year
- Implementation of the paper "Understanding anomaly detection with deep invertible networks through hierarchies of distributions and featu…☆42Nov 24, 2020Updated 5 years ago
- [ICLR 2025 Spotlight] Code release for "Sharpness-Aware Minimization Efficiently Selects Flatter Minima Late In Training"☆18Feb 20, 2025Updated last year
- [AAAI 2025]Automatically Generating Numerous Context-Driven SFT Data for LLMs across Diverse Granularity☆30Mar 17, 2025Updated last year
- [EMNLP 2025 Industry] Datasets and Recipes for Video Temporal Grounding via Reinforcement Learning☆36Oct 22, 2025Updated 7 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Suri: Multi-constraint instruction following for long-form text generation [EMNLP’24]☆27Oct 3, 2025Updated 7 months ago
- InsTag: A Tool for Data Analysis in LLM Supervised Fine-tuning☆285Aug 20, 2023Updated 2 years ago
- ☆20Nov 3, 2024Updated last year
- [EMNLP 2025] Verification Engineering for RL in Instruction Following☆55Mar 30, 2026Updated last month
- Tiny-Megatron, a minimalistic re-implementation of the Megatron library☆26Sep 1, 2025Updated 8 months ago
- Code implementation of synthetic continued pretraining☆160Jan 6, 2025Updated last year
- The RedStone repository includes code for preparing extensive datasets used in training large language models.☆161Apr 21, 2026Updated last month
- Multi-head Recurrent Layer Attention for Vision Network☆22Mar 2, 2023Updated 3 years ago
- GitHub repository of the ICLR 2023 paper "Neural Architecture Design and Robustness: A Dataset"☆16Jan 25, 2023Updated 3 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆40Updated this week
- ☆59Sep 2, 2024Updated last year
- [ACL2025 Findings] Official code for MIG: Automatic Data Selection for Instruction Tuning by Maximizing Information Gain in Semantic Spac…☆28Aug 30, 2025Updated 8 months ago
- ☆22Oct 22, 2024Updated last year
- [AAAI'26, Oral 🌟] Code for "Teaching Large Language Models to Maintain Contextual Faithfulness via Synthetic Tasks and Reinforcement Lea…☆45Jul 16, 2025Updated 10 months ago
- ☆28Jul 18, 2025Updated 10 months ago
- ☆120May 26, 2025Updated last year