Alternatives and similar repositories for alta

Users that are interested in alta are comparing it to the libraries listed below

• RobertCsordas / moeut
  ☆86Updated last year
• JoshEngels / MultiDimensionalFeatures
  Code for reproducing our paper "Not All Language Model Features Are Linear"
  ☆83Updated 11 months ago
• princeton-nlp / USACO
  Can Language Models Solve Olympiad Programming?
  ☆119Updated 9 months ago
• wesg52 / universal-neurons
  Universal Neurons in GPT2 Language Models
  ☆30Updated last year
• wmn-231314 / diffusion-data-constraint
  Official PyTorch implementation and models for paper "Diffusion Beats Autoregressive in Data-Constrained Settings". We find diffusion mod…
  ☆102Updated last week
• allenai / fluid-benchmarking
  Fluid Language Model Benchmarking
  ☆19Updated last month
• Parallel-Reasoning / APR
  [COLM 2025] Code for Paper: Learning Adaptive Parallel Reasoning with Language Models
  ☆132Updated 2 months ago
• JacobPfau / fillerTokens
  ☆74Updated last year
• katiekang1998 / reasoning_generalization
  ☆33Updated 9 months ago
• sail-sg / SkyLadder
  The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling
  ☆35Updated 2 weeks ago
• epfml / schedules-and-scaling
  Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"
  ☆84Updated last year
• Cranial-XIX / longhorn
  Official PyTorch Implementation of the Longhorn Deep State Space Model
  ☆55Updated 11 months ago
• upiterbarg / lintseq
  [ICLR 2025] "Training LMs on Synthetic Edit Sequences Improves Code Synthesis" (Piterbarg, Pinto, Fergus)
  ☆19Updated 8 months ago
• mnoukhov / async_rlhf
  Code and Configs for Asynchronous RLHF: Faster and More Efficient RL for Language Models
  ☆64Updated 6 months ago
• hughbzhang / o1_inference_scaling_laws
  Replicating O1 inference-time scaling laws
  ☆90Updated 11 months ago
• sail-sg / VeriFree
  Reinforcing General Reasoning without Verifiers
  ☆91Updated 4 months ago
• JinjieNi / dlms-are-super-data-learners
  The official github repo for "Diffusion Language Models are Super Data Learners".
  ☆139Updated last week
• Zyphra / tree_attention
  Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters
  ☆130Updated 11 months ago
• kanishkg / stream-of-search
  Repository for the paper Stream of Search: Learning to Search in Language
  ☆151Updated 9 months ago
• xu3kev / BARC
  Bootstrapping ARC
  ☆146Updated 11 months ago
• IBM / ColPret
  Efficient Scaling laws and collaborative pretraining.
  ☆18Updated last month
• Lagooon / LeanSTaR
  ☆42Updated last year
• likenneth / q_probe
  Q-Probe: A Lightweight Approach to Reward Maximization for Language Models
  ☆41Updated last year
• adamkarvonen / SAE_BoardGameEval
  ☆23Updated 9 months ago
• Laz4rz / mup
  Minimal (truly) muP implementation, consistent with TP4 and TP5 papers notation
  ☆14Updated 5 months ago
• gregorbachmann / Next-Token-Failures
  ☆103Updated last year
• complex-reasoning / RPG
  Official implementation of Regularized Policy Gradient (RPG) (https://arxiv.org/abs/2505.17508)
  ☆53Updated 2 weeks ago
• imagination-research / lbt
  [NeurIPS 2024] Can LLMs Learn by Teaching for Better Reasoning? A Preliminary Study
  ☆55Updated 11 months ago
• Phylliida / MambaLens
  Mamba support for transformer lens
  ☆18Updated last year
• mcleish7 / arithmetic
  Code to reproduce "Transformers Can Do Arithmetic with the Right Embeddings", McLeish et al (NeurIPS 2024)
  ☆193Updated last year