โ272Oct 27, 2025Updated last year
Alternatives and similar repositories for fineweb-2
Users that are interested in fineweb-2 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [EMNLP 2023] ๐ฌ Language Identification with Support for More Than 2000 Labelsโ224Updated this week
- Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.โ3,417Updated this week
- Minimalistic large language model 3D-parallelism trainingโ2,854Oct 8, 2026Updated last month
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backendsโ2,581Oct 29, 2026Updated last week
- Code for ICML 25 paper "Metadata Conditioning Accelerates Language Model Pre-training (MeCo)"โ54Jun 30, 2025Updated last year
- Managed Database hosting by DigitalOcean โข AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- DataComp for Language Modelsโ1,479Sep 9, 2025Updated last year
- Code repository for Group-MATES Group-Level Data Selection for Efficient Pretrainingโ13Jun 14, 2025Updated last year
- [NeurIPS 2024] ๐ธ GlotCC Dataset and Piplineโ21Apr 6, 2025Updated last year
- Organize the Web: Constructing Domains Enhances Pre-Training Data Curationโ85May 2, 2025Updated last year
- Ongoing research training transformer language models at scale, including: BERT & GPT-2โ20Oct 23, 2023Updated 3 years ago
- Code and training scripts for FlexOlmoโ158Apr 20, 2026Updated 6 months ago
- Using open source LLMs to build synthetic datasets for direct preference optimizationโ74Feb 29, 2024Updated 2 years ago
- [COLM 2024] Early Weight Averaging meets High Learning Rates for LLM Pre-trainingโ19Oct 12, 2024Updated 2 years ago
- AllenAI's post-training codebaseโ3,924Updated this week
- GPUs on demand by Runpod - Special Offer Available โข AdRun AI, ML, and HPC workloads on powerful cloud GPUsโwithout limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- โ578Nov 20, 2024Updated last year
- Collection of scripts and notebooks for OpenAI's latest GPT OSS modelsโ510Aug 25, 2025Updated last year
- State-of-the-art paired encoder and decoder models (17M-1B params)โ92Aug 6, 2025Updated last year
- A Large-Scale, High-Quality Math Dataset for Reinforcement Learning in Language Modelsโ77Feb 25, 2025Updated last year
- Scalable data pre processing and curation toolkit for LLMsโ1,856Updated this week
- ๐๏ธ Code for our paper: "Privasis: Synthesizing the Largest 'Public' Private Dataset from Scratch"โ16Jul 10, 2026Updated 3 months ago
- Data and tools for generating and inspecting OLMo pre-training data.โ1,562Aug 24, 2026Updated 2 months ago
- Safely push a Cog model version by making sure it works and is backwards-compatible with previous versions.โ17Updated this week
- [2022.05.16 ~ 2022.06.10] ๐ค๏ธ๋ฏธ์ธ๋จผ์ง ์๋ ๋ง์ ์ฌ์ง๐ท - ๋ถ์คํธ์บ ํ AI Tech 3๊ธฐ ์ต์ข ํ๋ก์ ํธโ14Jun 11, 2022Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways โข AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- When is multilinguality a curse? Language modeling for 250 high- and low-resource languages (EMNLP 2024).โ11Jan 30, 2025Updated last year
- 3-days AI hackathon by 1337AI and Math&Marocโ19Oct 16, 2024Updated 2 years ago
- โ19Aug 10, 2024Updated 2 years ago
- [NAACL'22] TaCL: Improving BERT Pre-training with Token-aware Contrastive Learningโ94Jun 8, 2022Updated 4 years ago
- Official repository for Fourier model that can generate periodic signalsโ10Mar 10, 2022Updated 4 years ago
- Code and data for "KoDialogBench: Evaluating Conversational Understanding of Language Models with Korean Dialogue Benchmark" (LREC-COLINGโฆโ18Apr 15, 2025Updated last year
- โ47Oct 11, 2023Updated 3 years ago
- Scalable toolkit for efficient model alignmentโ850Oct 6, 2025Updated last year
- [ICML 2025] Predictive Data Selection: The Data That Predicts Is the Data That Teachesโ67Mar 4, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways โข AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ๐งญ SailCompass: Towards Reproducible and Robust Evaluation for Southeast Asian Languagesโ13Feb 12, 2025Updated last year
- [EMNLP-2024] โ๏ธ Sailor: Open Language Models for South-East Asiaโ138Dec 21, 2024Updated last year
- โ43May 26, 2026Updated 5 months ago
- โ15Jun 21, 2026Updated 4 months ago
- ์ปค๋ฒ๋ฆฌ์คํธ - ๋ถ ์ปค๋ฒ ์์ฑ AI ์๋น์คโ13Sep 11, 2022Updated 4 years ago
- Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"โ94Oct 30, 2024Updated 2 years ago
- Everything about the SmolLM and SmolVLM family of modelsโ3,949Oct 6, 2026Updated last month