Alternatives and similar repositories for alta

Users that are interested in alta are comparing it to the libraries listed below

• wesg52 / universal-neurons
  Universal Neurons in GPT2 Language Models
  ☆30Updated last year
• gregorbachmann / Next-Token-Failures
  ☆98Updated last year
• RobertCsordas / moeut
  ☆85Updated last year
• princeton-nlp / USACO
  Can Language Models Solve Olympiad Programming?
  ☆119Updated 7 months ago
• JacobPfau / fillerTokens
  ☆72Updated last year
• epfml / schedules-and-scaling
  Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"
  ☆82Updated 10 months ago
• ApolloResearch / e2e_sae
  Sparse Autoencoder Training Library
  ☆54Updated 4 months ago
• JoshEngels / MultiDimensionalFeatures
  Code for reproducing our paper "Not All Language Model Features Are Linear"
  ☆77Updated 9 months ago
• mcleish7 / arithmetic
  Code to reproduce "Transformers Can Do Arithmetic with the Right Embeddings", McLeish et al (NeurIPS 2024)
  ☆192Updated last year
• adamkarvonen / SAE_BoardGameEval
  ☆23Updated 7 months ago
• sail-sg / SkyLadder
  The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling
  ☆33Updated last week
• berlino / seq_icl
  ☆53Updated last year
• ScalingIntelligence / large_language_monkeys
  ☆102Updated 11 months ago
• mcleish7 / gemstone-scaling-laws
  ☆28Updated 6 months ago
• mnoukhov / async_rlhf
  Code and Configs for Asynchronous RLHF: Faster and More Efficient RL for Language Models
  ☆61Updated 4 months ago
• formll / resolving-scaling-law-discrepancies
  ☆20Updated last year
• taufeeque9 / codebook-features
  Sparse and discrete interpretability tool for neural networks
  ☆63Updated last year
• sail-sg / VeriFree
  Reinforcing General Reasoning without Verifiers
  ☆80Updated 2 months ago
• IBM / ColPret
  Efficient Scaling laws and collaborative pretraining.
  ☆17Updated 7 months ago
• katiekang1998 / reasoning_generalization
  ☆34Updated 7 months ago
• shawntan / stickbreaking-attention
  Stick-breaking attention
  ☆59Updated 2 months ago
• tim-lawson / mlsae
  Multi-Layer Sparse Autoencoders (ICLR 2025)
  ☆24Updated 6 months ago
• HazyResearch / zoology
  Understand and test language model architectures on synthetic tasks.
  ☆222Updated last month
• upiterbarg / lintseq
  [ICLR 2025] "Training LMs on Synthetic Edit Sequences Improves Code Synthesis" (Piterbarg, Pinto, Fergus)
  ☆19Updated 6 months ago
• martin-marek / batch-size
  📄Small Batch Size Training for Language Models
  ☆43Updated last week
• Parallel-Reasoning / APR
  [COLM 2025] Code for Paper: Learning Adaptive Parallel Reasoning with Language Models
  ☆124Updated 2 weeks ago
• hughbzhang / o1_inference_scaling_laws
  Replicating O1 inference-time scaling laws
  ☆89Updated 9 months ago
• ryoungj / BoLT
  Code for "Reasoning to Learn from Latent Thoughts"
  ☆116Updated 5 months ago
• kanishkg / stream-of-search
  Repository for the paper Stream of Search: Learning to Search in Language
  ☆150Updated 6 months ago
• Cranial-XIX / longhorn
  Official PyTorch Implementation of the Longhorn Deep State Space Model
  ☆54Updated 8 months ago