Organize the Web: Constructing Domains Enhances Pre-Training Data Curation
☆79May 2, 2025Updated 10 months ago
Alternatives and similar repositories for WebOrganizer
Users that are interested in WebOrganizer are comparing it to the libraries listed below
Sorting:
- ☆17Mar 23, 2025Updated 11 months ago
- Aioli: A unified optimization framework for language model data mixing☆32Jan 17, 2025Updated last year
- An automated data pipeline scaling RL to pretraining levels☆74Oct 11, 2025Updated 5 months ago
- Official repository for MATES: Model-Aware Data Selection for Efficient Pretraining with Data Influence Models [NeurIPS 2024]☆79Nov 14, 2024Updated last year
- Implementation of stop sequencer for Huggingface Transformers☆16Jun 6, 2023Updated 2 years ago
- [ICLR 2025] 🧬 RegMix: Data Mixture as Regression for Language Model Pre-training (Spotlight)☆186Feb 17, 2025Updated last year
- Physics of Language Models: Part 4.2, Canon Layers at Scale where Synthetic Pretraining Resonates in Reality☆331Jan 5, 2026Updated 2 months ago
- ☆10Oct 20, 2023Updated 2 years ago
- GBM implementation on Legate☆14Jan 28, 2026Updated last month
- ☆51Jan 24, 2024Updated 2 years ago
- ☆33Feb 11, 2025Updated last year
- ☆14Jul 5, 2025Updated 8 months ago
- Ongoing research project for code&math LLMs☆27Jul 4, 2025Updated 8 months ago
- Minimal (truly) muP implementation, consistent with TP4 and TP5 papers notation☆14Jan 2, 2026Updated 2 months ago
- [ICML 2025] Predictive Data Selection: The Data That Predicts Is the Data That Teaches☆62Mar 4, 2025Updated last year
- Official code release for "SuperBPE: Space Travel for Language Models"☆90Jan 9, 2026Updated 2 months ago
- Simple and scalable tools for data-driven pretraining data selection.☆29Jun 9, 2025Updated 9 months ago
- This is an implementation of the paper "Are We Done with Object-Centric Learning?"☆12Sep 11, 2025Updated 6 months ago
- ☆13Jan 22, 2025Updated last year
- 💻 Terminal-Agent with Human-in-the-Loop Learning☆39Jan 16, 2026Updated 2 months ago
- Official PyTorch implementation and models for paper "Diffusion Beats Autoregressive in Data-Constrained Settings". We find diffusion mod…☆120Jan 10, 2026Updated 2 months ago
- This repository is associated with the research paper titled ImageChain: Advancing Sequential Image-to-Text Reasoning in Multimodal Large…☆15Jun 4, 2025Updated 9 months ago
- DataComp for Language Models☆1,426Sep 9, 2025Updated 6 months ago
- Shaping Language Models with Cognitive Insights☆15Feb 29, 2024Updated 2 years ago
- Generalizing from SIMPLE to HARD Visual Reasoning: Can We Mitigate Modality Imbalance in VLMs?☆17Jun 3, 2025Updated 9 months ago
- [EMNLP 2022] Language Model Pre-Training with Sparse Latent Typing☆14Feb 10, 2023Updated 3 years ago
- Explore what LLMs are really leanring over SFT☆28Mar 30, 2024Updated last year
- Code and datasets for "Text encoders are performance bottlenecks in contrastive vision-language models". Coming soon!☆11May 24, 2023Updated 2 years ago
- 🌾 OAT: A research-friendly framework for LLM online alignment, including reinforcement learning, preference learning, etc.☆639Jan 29, 2026Updated last month
- Heuristic filtering framework for RefineCode☆83Mar 13, 2025Updated last year
- SWE-Swiss: A Multi-Task Fine-Tuning and RL Recipe for High-Performance Issue Resolution☆103Sep 24, 2025Updated 5 months ago
- [COLM 2025] Official code for "When To Solve, When To Verify: Compute-Optimal Problem Solving and Generative Verification for LLM Reasoni…☆15Oct 31, 2025Updated 4 months ago
- Optimizing Anytime Reasoning via Budget Relative Policy Optimization☆52Jul 15, 2025Updated 8 months ago
- [COLM 2025] An Open Math Pre-trainng Dataset with 370B Tokens.☆110Apr 4, 2025Updated 11 months ago
- The official repository of 'Unnatural Language Are Not Bugs but Features for LLMs'☆24May 20, 2025Updated 10 months ago
- ☆10Jul 24, 2023Updated 2 years ago
- All-in-one benchmarking platform for evaluating LLM.☆15Nov 12, 2025Updated 4 months ago
- ☆14Updated this week
- ☆51Mar 9, 2026Updated last week