Alternatives and similar repositories for alta

Users that are interested in alta are comparing it to the libraries listed below

• RobertCsordas / moeut
  ☆82Updated 10 months ago
• epfml / schedules-and-scaling
  Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"
  ☆75Updated 8 months ago
• sail-sg / SkyLadder
  The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling
  ☆33Updated 3 months ago
• katiekang1998 / reasoning_generalization
  ☆33Updated 6 months ago
• dangxingyu / rnn-icrag
  Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"
  ☆27Updated last year
• shreyansh26 / Attention-Mask-Patterns
  Using FlexAttention to compute attention with different masking patterns
  ☆44Updated 9 months ago
• Asap7772 / understanding-rlhf
  Learning from preferences is a common paradigm for fine-tuning language models. Yet, many algorithmic design decisions come into play. Ou…
  ☆29Updated last year
• sjelassi / transformers_ssm_copy
  ☆32Updated last year
• likenneth / q_probe
  Q-Probe: A Lightweight Approach to Reward Maximization for Language Models
  ☆41Updated last year
• upiterbarg / lintseq
  [ICLR 2025] "Training LMs on Synthetic Edit Sequences Improves Code Synthesis" (Piterbarg, Pinto, Fergus)
  ☆19Updated 5 months ago
• wesg52 / universal-neurons
  Universal Neurons in GPT2 Language Models
  ☆30Updated last year
• princeton-nlp / USACO
  Can Language Models Solve Olympiad Programming?
  ☆119Updated 6 months ago
• Shalev-Lifshitz / MultiAgentVerification
  Multi-Agent Verification: Scaling Test-Time Compute with Multiple Verifiers
  ☆19Updated 4 months ago
• dvruette / barrel-rec-pytorch
  ☆53Updated last year
• JoshEngels / MultiDimensionalFeatures
  Code for reproducing our paper "Not All Language Model Features Are Linear"
  ☆77Updated 7 months ago
• adamkarvonen / SAE_BoardGameEval
  ☆23Updated 5 months ago
• shawntan / stickbreaking-attention
  Stick-breaking attention
  ☆58Updated 2 weeks ago
• OSU-NLP-Group / reversal-curse-binding
  ☆23Updated 3 months ago
• taufeeque9 / codebook-features
  Sparse and discrete interpretability tool for neural networks
  ☆63Updated last year
• Cranial-XIX / longhorn
  Official PyTorch Implementation of the Longhorn Deep State Space Model
  ☆53Updated 7 months ago
• gregorbachmann / Next-Token-Failures
  ☆87Updated last year
• shunzh / Code-AI-Tree-Search
  ☆119Updated last year
• mcleish7 / gemstone-scaling-laws
  ☆27Updated 5 months ago
• smonsays / hypernetwork-attention
  Official code for the paper "Attention as a Hypernetwork"
  ☆40Updated last year
• formll / resolving-scaling-law-discrepancies
  ☆20Updated last year
• facebookresearch / dualformer
  implementation of dualformer
  ☆18Updated 4 months ago
• amudide / switch_sae
  Efficient Dictionary Learning with Switch Sparse Autoencoders (SAEs)
  ☆25Updated 7 months ago
• facebookresearch / oni
  Learn online intrinsic rewards from LLM feedback
  ☆41Updated 7 months ago
• jysohn1108 / Looped-Transformer
  Official implementation of the transformer (TF) architecture suggested in a paper entitled "Looped Transformers as Programmable Computers…
  ☆27Updated 2 years ago
• berlino / seq_icl
  ☆53Updated last year