Organize the Web: Constructing Domains Enhances Pre-Training Data Curation
β85May 2, 2025Updated last year
Alternatives and similar repositories for WebOrganizer
Users that are interested in WebOrganizer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- β44May 26, 2026Updated 5 months ago
- [ICLR 2025] 𧬠RegMix: Data Mixture as Regression for Language Model Pre-training (Spotlight)β220Feb 17, 2025Updated last year
- Aioli: A unified optimization framework for language model data mixingβ34Jan 17, 2025Updated last year
- [ICML 2025] Predictive Data Selection: The Data That Predicts Is the Data That Teachesβ67Mar 4, 2025Updated last year
- Official repository for MATES: Model-Aware Data Selection for Efficient Pretraining with Data Influence Models [NeurIPS 2024]β80Nov 14, 2024Updated 2 years ago
- Proton VPN Special Offer - Get 70% off β’ AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Simple and scalable tools for data-driven pretraining data selection.β32Jun 9, 2025Updated last year
- Official repository for RePro: Training Language Models to Faithfully Recycle the Web for Pretrainingβ11Feb 18, 2026Updated 9 months ago
- [ICML 2024] Selecting High-Quality Data for Training Language Modelsβ203Dec 8, 2025Updated 11 months ago
- Official Code Repository for [AutoScaleπ: Scale-Aware Data Mixing for Pre-Training LLMs] Published as a conference paper at **COLM 2025*β¦β14Aug 8, 2025Updated last year
- Data mapping framework for rust stuffβ61Mar 25, 2026Updated 7 months ago
- Code for ICML 25 paper "Metadata Conditioning Accelerates Language Model Pre-training (MeCo)"β54Jun 30, 2025Updated last year
- Reproducible, flexible LLM evaluationsβ412Mar 24, 2026Updated 7 months ago
- [EMNLP24] Eliminating Biased Length Reliance of Direct Preference Optimization via Down-Sampled KL Divergenceβ13Oct 24, 2024Updated 2 years ago
- DataComp for Language Modelsβ1,479Sep 9, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer β’ AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Official Repository of Paper "Watch the Weights: Unsupervised monitoring and control of fine-tuned LLMs"β15Sep 25, 2025Updated last year
- β52Jan 24, 2024Updated 2 years ago
- Revisiting Mid-training in the Era of Reinforcement Learning Scalingβ188Jul 23, 2025Updated last year
- β11Sep 9, 2026Updated 2 months ago
- The official repository for SkyLadder: Better and Faster Pretraining via Context Window Schedulingβ44Dec 29, 2025Updated 10 months ago
- Tooling for exact and MinHash deduplication of large-scale text datasetsβ99Nov 7, 2026Updated last week
- Reinforcement Learning from Text Feedbackβ50Feb 17, 2026Updated 9 months ago
- CopyBench: Measuring Literal and Non-Literal Reproduction of Copyright-Protected Text in Language Model Generationβ14Aug 19, 2025Updated last year
- Language models scale reliably with over-training and on downstream tasksβ104Apr 2, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI β’ AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- DSIR large-scale data selection framework for language model trainingβ277Apr 7, 2024Updated 2 years ago
- β40Apr 17, 2024Updated 2 years ago
- Adversarial Tokenizationβ39Nov 21, 2025Updated 11 months ago
- β12Jun 20, 2024Updated 2 years ago
- β28Mar 21, 2024Updated 2 years ago
- A Model Agnostic function to directly remove specified layers from the LLMβ11May 23, 2024Updated 2 years ago
- β24Jun 30, 2026Updated 4 months ago
- Experimental tl;dr summaries for datasets on the Hugging Face Hub!β10Apr 4, 2024Updated 2 years ago
- π’ Data Toolkit for Sailor Language Modelsβ94Feb 24, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways β’ AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Ongoing research project for code&math LLMsβ32Jul 4, 2025Updated last year
- β89Apr 20, 2026Updated 6 months ago
- β17Sep 11, 2026Updated 2 months ago
- What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasetsβ229Nov 16, 2024Updated 2 years ago
- πΎ OAT: A research-friendly framework for LLM online alignment, including reinforcement learning, preference learning, etc.β678Jan 29, 2026Updated 9 months ago
- The simplest, fastest repository for training/finetuning medium-sized GPTs.β207Jan 19, 2026Updated 9 months ago
- Implementation of stop sequencer for Huggingface Transformersβ16Jun 6, 2023Updated 3 years ago
Are these results useful?