Alternatives and similar repositories for alta

Users that are interested in alta are comparing it to the libraries listed below

• google-deepmind / superhuman
  ☆85Updated this week
• RobertCsordas / moeut
  ☆91Updated last year
• wmn-231314 / diffusion-data-constraint
  Official PyTorch implementation and models for paper "Diffusion Beats Autoregressive in Data-Constrained Settings". We find diffusion mod…
  ☆119Updated 3 weeks ago
• katiekang1998 / reasoning_generalization
  ☆33Updated last year
• allenai / fluid-benchmarking
  Fluid Language Model Benchmarking
  ☆25Updated 4 months ago
• sail-sg / SkyLadder
  The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling
  ☆42Updated last month
• JacobPfau / fillerTokens
  ☆75Updated last year
• Phylliida / MambaLens
  Mamba support for transformer lens
  ☆18Updated last year
• epfml / schedules-and-scaling
  Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"
  ☆88Updated last year
• berlino / seq_icl
  ☆53Updated last year
• wesg52 / universal-neurons
  Universal Neurons in GPT2 Language Models
  ☆30Updated last year
• dangxingyu / rnn-icrag
  Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"
  ☆27Updated last year
• princeton-nlp / USACO
  Can Language Models Solve Olympiad Programming?
  ☆123Updated last year
• adamkarvonen / SAE_BoardGameEval
  ☆23Updated last year
• JoshEngels / MultiDimensionalFeatures
  Code for reproducing our paper "Not All Language Model Features Are Linear"
  ☆83Updated last year
• thinking-machines-lab / manifolds
  Supporting code for the blog post on modular manifolds.
  ☆113Updated 4 months ago
• complex-reasoning / RPG
  [ICLR 2026] RPG: KL-Regularized Policy Gradient (https://arxiv.org/abs/2505.17508)
  ☆64Updated this week
• sjelassi / transformers_ssm_copy
  ☆35Updated last year
• aisa-group / PostTrainBench
  PostTrainBench measures how well CLI agents like Claude Code or Codex CLI can post-train base LLMs on a single H100 GPU in 10 hours
  ☆118Updated last week
• shreyansh26 / Attention-Mask-Patterns
  Using FlexAttention to compute attention with different masking patterns
  ☆47Updated last year
• upiterbarg / lintseq
  [ICLR 2025] "Training LMs on Synthetic Edit Sequences Improves Code Synthesis" (Piterbarg, Pinto, Fergus)
  ☆19Updated 11 months ago
• g-luo / vlm_cross_modal_reps
  Official PyTorch Implementation for Vision-Language Models Create Cross-Modal Task Representations, ICML 2025
  ☆31Updated 8 months ago
• IBM / ColPret
  Efficient Scaling laws and collaborative pretraining.
  ☆20Updated 4 months ago
• mcleish7 / gemstone-scaling-laws
  Gemstones: A Model Suite for Multi-Faceted Scaling Laws (NeurIPS 2025)
  ☆32Updated 4 months ago
• facebookresearch / llm-speedrunner
  The Automated LLM Speedrunning Benchmark measures how well LLM agents can reproduce previous innovations and discover new ones in languag…
  ☆127Updated 3 months ago
• tim-lawson / mlsae
  Multi-Layer Sparse Autoencoders (ICLR 2025)
  ☆28Updated 11 months ago
• shawntan / stickbreaking-attention
  Stick-breaking attention
  ☆62Updated 6 months ago
• Zyphra / tree_attention
  Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters
  ☆131Updated last year
• sunblaze-ucb / omega
  ☆45Updated 7 months ago
• hughbzhang / o1_inference_scaling_laws
  Replicating O1 inference-time scaling laws
  ☆91Updated last year