Alternatives and similar repositories for alta

Users that are interested in alta are comparing it to the libraries listed below

• RobertCsordas / moeut
  ☆91Updated last year
• wesg52 / universal-neurons
  Universal Neurons in GPT2 Language Models
  ☆31Updated last year
• google-deepmind / superhuman
  ☆79Updated last month
• katiekang1998 / reasoning_generalization
  ☆33Updated 11 months ago
• princeton-nlp / USACO
  Can Language Models Solve Olympiad Programming?
  ☆124Updated 11 months ago
• sail-sg / SkyLadder
  The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling
  ☆40Updated 2 months ago
• JacobPfau / fillerTokens
  ☆75Updated last year
• epfml / schedules-and-scaling
  Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"
  ☆86Updated last year
• complex-reasoning / RPG
  Official implementation of Regularized Policy Gradient (RPG) (https://arxiv.org/abs/2505.17508)
  ☆60Updated 2 months ago
• wmn-231314 / diffusion-data-constraint
  Official PyTorch implementation and models for paper "Diffusion Beats Autoregressive in Data-Constrained Settings". We find diffusion mod…
  ☆117Updated 2 months ago
• convergence-ai / lm2
  Official repo of paper LM2
  ☆46Updated 10 months ago
• IBM / ColPret
  Efficient Scaling laws and collaborative pretraining.
  ☆19Updated 3 months ago
• gregorbachmann / Next-Token-Failures
  ☆107Updated last year
• JoshEngels / MultiDimensionalFeatures
  Code for reproducing our paper "Not All Language Model Features Are Linear"
  ☆83Updated last year
• shawntan / stickbreaking-attention
  Stick-breaking attention
  ☆62Updated 5 months ago
• berlino / seq_icl
  ☆53Updated last year
• JinjieNi / dlms-are-super-data-learners
  The official github repo for "Diffusion Language Models are Super Data Learners".
  ☆215Updated last month
• imagination-research / lbt
  [NeurIPS 2024] Can LLMs Learn by Teaching for Better Reasoning? A Preliminary Study
  ☆57Updated last year
• Cranial-XIX / longhorn
  Official PyTorch Implementation of the Longhorn Deep State Space Model
  ☆57Updated last year
• formll / resolving-scaling-law-discrepancies
  ☆20Updated last month
• ahstat / episodic-memory-benchmark
  Synthetic data generation and benchmark implementation for "Episodic Memories Generation and Evaluation Benchmark for Large Language Mode…
  ☆62Updated 2 months ago
• facebookresearch / MemoryMosaics
  Memory Mosaics are networks of associative memories working in concert to achieve a prediction task.
  ☆57Updated 10 months ago
• dangxingyu / rnn-icrag
  Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"
  ☆27Updated last year
• Parallel-Reasoning / APR
  [COLM 2025] Code for Paper: Learning Adaptive Parallel Reasoning with Language Models
  ☆136Updated last week
• main-horse / hnet-old
  H-Net Dynamic Hierarchical Architecture
  ☆80Updated 3 months ago
• Zyphra / tree_attention
  Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters
  ☆131Updated last year
• mcleish7 / arithmetic
  Code to reproduce "Transformers Can Do Arithmetic with the Right Embeddings", McLeish et al (NeurIPS 2024)
  ☆198Updated last year
• Edward-Sun / gpt-accelera
  Simple and efficient pytorch-native transformer training and inference (batched)
  ☆79Updated last year
• ChenWu98 / algorithmic-creativity
  [ICML 2025] Roll the dice & look before you leap: Going beyond the creative limits of next-token prediction
  ☆82Updated 7 months ago
• upiterbarg / lintseq
  [ICLR 2025] "Training LMs on Synthetic Edit Sequences Improves Code Synthesis" (Piterbarg, Pinto, Fergus)
  ☆19Updated 10 months ago