Alternatives and similar repositories for Synthetic_Continued_Pretraining

Users that are interested in Synthetic_Continued_Pretraining are comparing it to the libraries listed below

• yyDing1 / ScaleQuest

  View on GitHub
  [ACL 2025] We introduce ScaleQuest, a scalable, novel and cost-effective data synthesis method to unleash the reasoning capability of LLM…
  ☆68Oct 27, 2024Updated last year
• zhang-wei-chao / DC-PDD

  View on GitHub
  This repository presents the original implementation of Pretraining Data Detection for Large Language Models: A Divergence-based Calibrat…
  ☆21May 21, 2025Updated 8 months ago
• huggingface / cosmopedia

  View on GitHub
  ☆564Nov 20, 2024Updated last year
• MadryLab / journey-TRAK

  View on GitHub
  Code for the paper "The Journey, Not the Destination: How Data Guides Diffusion Models"
  ☆25Dec 12, 2023Updated 2 years ago
• huangJC0429 / Mid-GCN

  View on GitHub
  This is the code of paper: Robust Mid-Pass Filtering Graph Convolutional Networks.(paper accepted by WWW2023)
  ☆13Feb 17, 2023Updated 2 years ago
• yuanyehome / PALT

  View on GitHub
  This is the source code of our paper PALT in EMNLP2022.
  ☆13Nov 19, 2022Updated 3 years ago
• dual-view-molecule-pretraining / dmp

  View on GitHub
  ☆11Jun 4, 2021Updated 4 years ago
• pzs19 / LEMMA

  View on GitHub
  ☆16Sep 4, 2025Updated 5 months ago
• tonghuikang / automatic-prompt-engineer

  View on GitHub
  Generates and optimizes Haiku system and user prompts for classification
  ☆14Oct 27, 2025Updated 3 months ago
• tianyi-lab / RuleR

  View on GitHub
  [NAACL'25] RuleR: Improving LLM Controllability by Rule-based Data Recycling
  ☆14Sep 27, 2025Updated 4 months ago
• hkust-nlp / deita

  View on GitHub
  Deita: Data-Efficient Instruction Tuning for Alignment [ICLR2024]
  ☆588Dec 9, 2024Updated last year
• eujhwang / vn-analysis

  View on GitHub
  virtual node analysis on ogb benchmark dataset
  ☆14Mar 9, 2023Updated 2 years ago
• HowieHwong / DataGen

  View on GitHub
  [ICLR'25] DataGen: Unified Synthetic Dataset Generation via Large Language Models
  ☆65Mar 8, 2025Updated 11 months ago
• eidonfiloi / SparseRecurrentNetwork

  View on GitHub
  ☆10Nov 19, 2015Updated 10 years ago
• facebookresearch / dual-system-for-visual-language-reasoning

  View on GitHub
  Github repo for Peifeng's internship project
  ☆13Nov 7, 2023Updated 2 years ago
• OFA-Sys / InsTag

  View on GitHub
  InsTag: A Tool for Data Analysis in LLM Supervised Fine-tuning
  ☆285Aug 20, 2023Updated 2 years ago
• zhengxxn / UDA-KNN

  View on GitHub
  ☆12Aug 31, 2021Updated 4 years ago
• shuheikatoinfo / UtterTune

  View on GitHub
  LoRA-based phoneme/prosody control for LLM-based TTS with no G2P - Lightweight adapter for edit and control the target language's phoneme…
  ☆23Aug 14, 2025Updated 6 months ago
• yaolu-zjut / DDInterpreter

  View on GitHub
  ☆15May 28, 2024Updated last year
• MadryLab / datamodels-data

  View on GitHub
  Data for "Datamodels: Predicting Predictions with Training Data"
  ☆97May 25, 2023Updated 2 years ago
• yuleiqin / fantastic-data-engineering

  View on GitHub
  Fantastic Data Engineering for Large Language Models
  ☆93Dec 29, 2024Updated last year
• mlfoundations / dclm

  View on GitHub
  DataComp for Language Models
  ☆1,416Sep 9, 2025Updated 5 months ago
• feiyang-k / AutoScale

  View on GitHub
  Official Code Repository for [AutoScale📈: Scale-Aware Data Mixing for Pre-Training LLMs] Published as a conference paper at **COLM 2025*…
  ☆13Aug 8, 2025Updated 6 months ago
• Jiachen-T-Wang / GREATS

  View on GitHub
  ☆17Mar 23, 2025Updated 10 months ago
• TheaperDeng / GNN-Attack-InfMax

  View on GitHub
  Adversarial Attack on Graph Neural Networks as An Influence Maximization Problem
  ☆20Oct 27, 2021Updated 4 years ago
• stanford-cs336 / spring2024-assignment2-systems

  View on GitHub
  ☆18May 3, 2024Updated last year
• rtaori / data_feedback

  View on GitHub
  Code for the paper "Data Feedback Loops: Model-driven Amplification of Dataset Biases"
  ☆18Sep 9, 2022Updated 3 years ago
• alexzhang13 / Triton-Puzzles-Solutions

  View on GitHub
  Personal solutions to the Triton Puzzles
  ☆20Jul 18, 2024Updated last year
• vasishtduddu / GraphLeaks

  View on GitHub
  Code for the paper "Quantifying Privacy Leakage in Graph Embedding" published in MobiQuitous 2020
  ☆17Nov 11, 2021Updated 4 years ago
• wasiahmad / Awesome-LLM-Synthetic-Data

  View on GitHub
  A reading list on LLM based Synthetic Data Generation 🔥
  ☆1,516Jun 5, 2025Updated 8 months ago
• pengr / DataMan

  View on GitHub
  Our code for ICLR'25 paper "DataMan: Data Manager for Pre-training Large Language Models".
  ☆118Feb 7, 2026Updated last week
• upiterbarg / lintseq

  View on GitHub
  [ICLR 2025] "Training LMs on Synthetic Edit Sequences Improves Code Synthesis" (Piterbarg, Pinto, Fergus)
  ☆19Feb 11, 2025Updated last year
• Xzh0u / GBK-GNN

  View on GitHub
  Code for GBK-GNN (paper accepted by WWW2022)
  ☆17Jun 16, 2022Updated 3 years ago
• yolky / RFAD

  View on GitHub
  Code for the paper "Efficient Dataset Distillation using Random Feature Approximation"
  ☆37Feb 24, 2023Updated 2 years ago
• huggingface / llm-swarm

  View on GitHub
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆280Jul 11, 2024Updated last year
• g-benton / hessian-eff-dim

  View on GitHub
  Public Codebase for Rethinking Parameter Counting: Effective Dimensionality Revisited
  ☆37Dec 27, 2022Updated 3 years ago
• shehper / scaling_laws

  View on GitHub
  An open-source implementation of Scaling Laws for Neural Language Models using nanoGPT
  ☆54Dec 8, 2023Updated 2 years ago
• pengr / LLM-Synthetic-Data

  View on GitHub
  A live reading list for LLM data synthesis (Updated to July, 2025).
  ☆450Aug 26, 2025Updated 5 months ago
• ai4sci-research / ai4sci-research.github.io

  View on GitHub
  ☆17Jun 3, 2024Updated last year