Official repository for RePro: Training Language Models to Faithfully Recycle the Web for Pretraining
☆11Feb 18, 2026Updated 8 months ago
Alternatives and similar repositories for RePro
Users that are interested in RePro are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Code repository for Group-MATES Group-Level Data Selection for Efficient Pretraining☆13Jun 14, 2025Updated last year
- Official repository for MATES: Model-Aware Data Selection for Efficient Pretraining with Data Influence Models [NeurIPS 2024]☆80Nov 14, 2024Updated last year
- Joint Selection for Large-Scale Pre-Training Data via Policy Gradient-based Mask Learning☆22Jan 4, 2026Updated 10 months ago
- 🧭 SailCompass: Towards Reproducible and Robust Evaluation for Southeast Asian Languages☆13Feb 12, 2025Updated last year
- ☆13Aug 12, 2026Updated 3 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆11Aug 3, 2025Updated last year
- DeepSpot is a deep learning method for the enhancement of mRNA fluorescent spots in microscopy images☆15Dec 1, 2021Updated 4 years ago
- An implementation of online data mixing for the Pile dataset, based on the GPT-NeoX library.☆15Jan 9, 2024Updated 2 years ago
- A curated list of awesome resources dedicated to Scaling Laws for LLMs☆85Apr 10, 2023Updated 3 years ago
- ☆52Aug 20, 2025Updated last year
- Web archiving utility library☆12Nov 3, 2026Updated last week
- Automatica Open Web Data Collection (NeurIPS 2025)☆16Dec 2, 2025Updated 11 months ago
- Organize the Web: Constructing Domains Enhances Pre-Training Data Curation☆85May 2, 2025Updated last year
- The training framework of PCMind-2.1-Kaiyuan-2B built on MindFormers☆15Dec 9, 2025Updated 11 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Intriguing Properties of Data Attribution on Diffusion Models (ICLR 2024)☆38Jan 23, 2024Updated 2 years ago
- ReCross: Unsupervised Cross-Task Generalization via Retrieval Augmentation☆23May 1, 2022Updated 4 years ago
- The LM Contamination Index is a manually created database of contamination evidences for LMs.☆82Apr 11, 2024Updated 2 years ago
- Code for the paper "Mehta, S. V., Patil, D., Chandar, S., & Strubell, E. (2023). An Empirical Investigation of the Role of Pre-training i…☆18Mar 18, 2024Updated 2 years ago
- ☆28Dec 18, 2024Updated last year
- Official Repository for Dataset Inference for LLMs☆42Jul 25, 2024Updated 2 years ago
- Learning to route instances for Human vs AI Feedback (ACL Main '25)☆30Jul 23, 2025Updated last year
- Aioli: A unified optimization framework for language model data mixing☆34Jan 17, 2025Updated last year
- daVinci-Agency: Unlocking Long-Horizon Agency Data-Efficiently☆38Feb 4, 2026Updated 9 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Resources for Retrieval Augmentation for Commonsense Reasoning: A Unified Approach. EMNLP 2022.☆25Nov 23, 2022Updated 3 years ago
- Exploration of automated dataset selection approaches at large scales.☆56Mar 4, 2025Updated last year
- A Query fan-out analyser for AI Search☆15Updated this week
- This is the official implementation for our ACL 2024 paper: "Causal Estimation of Memorisation Profiles".☆25Mar 25, 2025Updated last year
- [ICLR 2025] 🧬 RegMix: Data Mixture as Regression for Language Model Pre-training (Spotlight)☆219Feb 17, 2025Updated last year
- Code for "Can Retriever-Augmented Language Models Reason? The Blame Game Between the Retriever and the Language Model", EMNLP Findings 20…☆27Nov 2, 2023Updated 3 years ago
- Source code for COLING 2022 paper "Automatic Label Sequence Generation for Prompting Sequence-to-sequence Models"☆23Sep 21, 2022Updated 4 years ago
- Official repository for Montessori-Instruct: Generate Influential Training Data Tailored for Student Learning [ICLR 2025]☆51Jan 24, 2025Updated last year
- DiWA: Diverse Weight Averaging for Out-of-Distribution Generalization☆31Jan 31, 2023Updated 3 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Language models scale reliably with over-training and on downstream tasks☆104Apr 2, 2024Updated 2 years ago
- What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets☆229Nov 16, 2024Updated last year
- 🔱 Sailor2: Sailing in South-East Asia with Inclusive Multilingual LLMs☆74Mar 21, 2025Updated last year
- DataInf: Efficiently Estimating Data Influence in LoRA-tuned LLMs and Diffusion Models (ICLR 2024)☆84Oct 3, 2024Updated 2 years ago
- Simple and scalable tools for data-driven pretraining data selection.☆32Jun 9, 2025Updated last year
- MCP server that analyses your published writing and generates a Claude Skill so Claude writes prose in your voice by mimicking real sampl…☆11Aug 8, 2026Updated 3 months ago
- Plugins for use with PhoneGap.☆13Jan 21, 2012Updated 14 years ago
Are these results useful?