Alternatives and similar repositories for mixinglaws

Users that are interested in mixinglaws are comparing it to the libraries listed below

• feiyang-k / AutoScale

  View on GitHub
  Official Code Repository for [AutoScale📈: Scale-Aware Data Mixing for Pre-Training LLMs] Published as a conference paper at **COLM 2025*…
  ☆13Aug 8, 2025Updated 6 months ago
• locuslab / scaling_laws_data_filtering

  View on GitHub
  ☆64Apr 9, 2024Updated last year
• alon-albalak / online-data-mixing

  View on GitHub
  An implementation of online data mixing for the Pile dataset, based on the GPT-NeoX library.
  ☆13Jan 9, 2024Updated 2 years ago
• sail-sg / regmix

  View on GitHub
  [ICLR 2025] 🧬 RegMix: Data Mixture as Regression for Language Model Pre-training (Spotlight)
  ☆185Feb 17, 2025Updated 11 months ago
• cofe-ai / Mu-scaling

  View on GitHub
  Research without Re-search: Maximal Update Parametrization Yields Accurate Loss Prediction across Scales
  ☆32Jul 17, 2023Updated 2 years ago
• choosewhatulike / cluster-clip

  View on GitHub
  Multi-GPU supported kmeans clustering for cluser-clip
  ☆15Jun 3, 2024Updated last year
• Lyun0912-wu / LongAttn

  View on GitHub
  LongAttn ：Selecting Long-context Training Data via Token-level Attention
  ☆15Jul 16, 2025Updated 6 months ago
• yikangshen / megablocks

  View on GitHub
  ☆20May 30, 2024Updated last year
• thu-wyz / inference_scaling

  View on GitHub
  ☆78Nov 19, 2024Updated last year
• yiqingxyq / RepoST

  View on GitHub
  Code for "[COLM'25] RepoST: Scalable Repository-Level Coding Environment Construction with Sandbox Testing"
  ☆22Mar 18, 2025Updated 10 months ago
• john-hewitt / implicit-ins

  View on GitHub
  Codebase for Instruction Following without Instruction Tuning
  ☆36Sep 24, 2024Updated last year
• OpenLMLab / ParallelTokenizer

  View on GitHub
  Use the tokenizer in parallel to achieve superior acceleration
  ☆20Mar 21, 2024Updated last year
• sangmichaelxie / doremi

  View on GitHub
  Pytorch implementation of DoReMi, a method for optimizing the data mixture weights in language modeling datasets
  ☆350Dec 26, 2023Updated 2 years ago
• RUCAIBox / BAMBOO

  View on GitHub
  ☆35Mar 25, 2024Updated last year
• Cornell-RL / drpo

  View on GitHub
  Dateset Reset Policy Optimization
  ☆31Apr 12, 2024Updated last year
• sanyalsunny111 / LLM-Inheritune

  View on GitHub
  [TMLR 2026] When Attention Collapses: How Degenerate Layers in LLMs Enable Smaller, Stronger Models
  ☆122Feb 10, 2025Updated last year
• huggingface / datablations

  View on GitHub
  Scaling Data-Constrained Language Models
  ☆341Jun 28, 2025Updated 7 months ago
• OpenLMLab / scaling-rope

  View on GitHub
  code for Scaling Laws of RoPE-based Extrapolation
  ☆73Oct 16, 2023Updated 2 years ago
• hkust-nlp / llm-compression-intelligence

  View on GitHub
  Official github repo for the paper "Compression Represents Intelligence Linearly" [COLM 2024]
  ☆147Sep 20, 2024Updated last year
• microsoft / rho

  View on GitHub
  Repo for Rho-1: Token-level Data Selection & Selective Pretraining of LLMs.
  ☆459Apr 18, 2024Updated last year
• RESIN-KAIROS / RESIN-11

  View on GitHub
  ☆20Jul 18, 2022Updated 3 years ago
• yifanzhang-pro / AutoMathText

  View on GitHub
  [ACL 2025 Findings] Autonomous Data Selection with Zero-shot Generative Classifiers for Mathematical Texts (As Huggingface Daily Papers: …
  ☆90Nov 23, 2025Updated 2 months ago
• multimodal-art-projection / MAP-NEO

  View on GitHub
  ☆979Feb 7, 2025Updated last year
• lm-sys / llm-decontaminator

  View on GitHub
  Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"
  ☆316Dec 20, 2023Updated 2 years ago
• MadryLab / DsDm

  View on GitHub
  ☆51Jan 24, 2024Updated 2 years ago
• InternLM / Condor

  View on GitHub
  [ACL 2025] An official pytorch implement of the paper: Condor: Enhance LLM Alignment with Knowledge-Driven Data Synthesis and Refinement
  ☆40May 28, 2025Updated 8 months ago
• princeton-nlp / LLM-Shearing

  View on GitHub
  [ICLR 2024] Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning
  ☆640Mar 4, 2024Updated last year
• IBM / ColPret

  View on GitHub
  Efficient Scaling laws and collaborative pretraining.
  ☆20Sep 18, 2025Updated 4 months ago
• hkust-nlp / deita

  View on GitHub
  Deita: Data-Efficient Instruction Tuning for Alignment [ICLR2024]
  ☆588Dec 9, 2024Updated last year
• tongxuluo / prts

  View on GitHub
  Code and Model for NeurIPS 2024 Spotlight Paper "Stacking Your Transformers: A Closer Look at Model Growth for Efficient LLM Pre-Training…
  ☆44Oct 16, 2024Updated last year
• princeton-nlp / QuRating

  View on GitHub
  [ICML 2024] Selecting High-Quality Data for Training Language Models
  ☆201Dec 8, 2025Updated 2 months ago
• OpenMOSS / Thus-Spake-Long-Context-LLM

  View on GitHub
  a survey of long-context LLMs from four perspectives, architecture, infrastructure, training, and evaluation
  ☆61Mar 31, 2025Updated 10 months ago
• yhcc / utcie

  View on GitHub
  This is the code repo for the paper <UTC-IE: A Unified Token-pair Classification Architecture for Information Extraction>
  ☆15Aug 10, 2023Updated 2 years ago
• RUCAIBox / Slow_Thinking_with_LLMs

  View on GitHub
  A series of technical report on Slow Thinking with LLM
  ☆759Aug 13, 2025Updated 6 months ago
• Jiachen-T-Wang / GREATS

  View on GitHub
  ☆17Mar 23, 2025Updated 10 months ago
• limenlp / safer-instruct

  View on GitHub
  This is the oficial repository for "Safer-Instruct: Aligning Language Models with Automated Preference Data"
  ☆17Feb 22, 2024Updated last year
• automl / unlocking_state_tracking

  View on GitHub
  Expanding linear RNN state-transition matrix eigenvalues to include negatives improves state-tracking tasks and language modeling without…
  ☆19Mar 15, 2025Updated 11 months ago
• zsLin177 / SRL-as-GP

  View on GitHub
  ☆18Mar 10, 2023Updated 2 years ago
• LCM-Lab / LOOM-Eval

  View on GitHub
  A comprehensive and efficient long-context model evaluation framework
  ☆30Feb 8, 2026Updated last week