Alternatives and similar repositories for llm-optimizer-benchmark

Users that are interested in llm-optimizer-benchmark are comparing it to the libraries listed below

• Leooyii / LCEG
  Long Context Extension and Generalization in LLMs
  ☆62Updated last year
• epfml / schedules-and-scaling
  Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"
  ☆85Updated last year
• mlfoundations / scaling
  Language models scale reliably with over-training and on downstream tasks
  ☆100Updated last year
• hkust-nlp / PreSelect
  [ICML 2025] Predictive Data Selection: The Data That Predicts Is the Data That Teaches
  ☆56Updated 8 months ago
• mcleish7 / gemstone-scaling-laws
  Gemstones: A Model Suite for Multi-Faceted Scaling Laws (NeurIPS 2025)
  ☆29Updated last month
• shreyansh26 / Attention-Mask-Patterns
  Using FlexAttention to compute attention with different masking patterns
  ☆47Updated last year
• RobertCsordas / moeut
  ☆87Updated last year
• sail-sg / SkyLadder
  The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling
  ☆40Updated last month
• gregorbachmann / Next-Token-Failures
  ☆104Updated last year
• hamishivi / automated-instruction-selection
  Exploration of automated dataset selection approaches at large scales.
  ☆48Updated 8 months ago
• sail-sg / scaling-with-vocab
  [NeurIPS-2024] 📈 Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies https://arxiv.org/abs/2407.13623
  ☆89Updated last year
• facebookresearch / PhysicsLM4
  Physics of Language Models, Part 4
  ☆255Updated 3 months ago
• CodeCreator / WebOrganizer
  Organize the Web: Constructing Domains Enhances Pre-Training Data Curation
  ☆68Updated 6 months ago
• berlino / seq_icl
  ☆53Updated last year
• sunblaze-ucb / rl-grok-recipe
  Code repository for "RL Grokking Recipe: How RL Unlocks and Transfers New Algorithms in LLMs""
  ☆23Updated last month
• ryoungj / BoLT
  Code for "Reasoning to Learn from Latent Thoughts"
  ☆122Updated 7 months ago
• hamishivi / EasyLM
  Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…
  ☆75Updated last year
• kamanphoebe / Look-into-MoEs
  [NAACL 2025] A Closer Look into Mixture-of-Experts in Large Language Models
  ☆55Updated 9 months ago
• shawntan / stickbreaking-attention
  Stick-breaking attention
  ☆61Updated 4 months ago
• hughbzhang / o1_inference_scaling_laws
  Replicating O1 inference-time scaling laws
  ☆90Updated 11 months ago
• katiekang1998 / reasoning_generalization
  ☆33Updated 10 months ago
• PKU-ML / LongPPL
  Code for ICLR 2025 Paper "What is Wrong with Perplexity for Long-context Language Modeling?"
  ☆105Updated last month
• Edward-Sun / gpt-accelera
  Simple and efficient pytorch-native transformer training and inference (batched)
  ☆78Updated last year
• formll / resolving-scaling-law-discrepancies
  ☆20Updated last week
• MLE-Dojo / MLE-Dojo
  ☆77Updated 2 weeks ago
• yidingjiang / ado
  The repository contains code for Adaptive Data Optimization
  ☆28Updated 11 months ago
• facebookresearch / iGSM
  The code for creating the iGSM datasets in papers "Physics of Language Models Part 2.1, Grade-School Math and the Hidden Reasoning Proces…
  ☆80Updated 10 months ago
• TianduoWang / DPO-ST
  [ACL 2024] Self-Training with Direct Preference Optimization Improves Chain-of-Thought Reasoning
  ☆52Updated last year
• zyushun / hessian-spectrum
  Code for the paper: Why Transformers Need Adam: A Hessian Perspective
  ☆64Updated 8 months ago
• sail-sg / VeriFree
  Reinforcing General Reasoning without Verifiers
  ☆92Updated 4 months ago