Alternatives and similar repositories for LoGAH

Users that are interested in LoGAH are comparing it to the libraries listed below

• SamsungSAILMontreal / nino
  Code for "Accelerating Training with Neuron Interaction and Nowcasting Networks" [to appear at ICLR 2025]
  ☆19Updated last month
• facebookresearch / dualformer
  implementation of dualformer
  ☆18Updated 4 months ago
• EleutherAI / mdl
  Minimum Description Length probing for neural network representations
  ☆18Updated 5 months ago
• TRI-ML / linear_open_lm
  A repository for research on medium sized language models.
  ☆77Updated last year
• codezakh / DataEnvGym
  A testbed for agents and environments that can automatically improve models through data generation.
  ☆24Updated 4 months ago
• amirzandieh / HyperAttention
  Triton Implementation of HyperAttention Algorithm
  ☆48Updated last year
• IBM / ColPret
  Efficient Scaling laws and collaborative pretraining.
  ☆16Updated 5 months ago
• recursal / GoldFinch-paper
  GoldFinch and other hybrid transformer components
  ☆46Updated 11 months ago
• Shalev-Lifshitz / MultiAgentVerification
  Multi-Agent Verification: Scaling Test-Time Compute with Multiple Verifiers
  ☆19Updated 4 months ago
• edwardmilsom / function-space-learning-rates-paper
  Code for the paper "Function-Space Learning Rates"
  ☆20Updated last month
• RobertCsordas / moeut
  ☆82Updated 10 months ago
• shreyansh26 / Attention-Mask-Patterns
  Using FlexAttention to compute attention with different masking patterns
  ☆44Updated 9 months ago
• ml-jku / EVA
  One Initialization to Rule them All: Fine-tuning via Explained Variance Adaptation
  ☆40Updated 9 months ago
• IdoAmos / not-from-scratch
  ☆32Updated 8 months ago
• dangxingyu / rnn-icrag
  Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"
  ☆27Updated last year
• RobertCsordas / moe
  Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"
  ☆38Updated last month
• likenneth / q_probe
  Q-Probe: A Lightweight Approach to Reward Maximization for Language Models
  ☆41Updated last year
• aniquetahir / JORA
  JORA: JAX Tensor-Parallel LoRA Library (ACL 2024)
  ☆34Updated last year
• s-sahoo / Eso-LMs
  Esoteric Language Models
  ☆87Updated 3 weeks ago
• kyleliang919 / Online-Subspace-Descent
  [NeurIPS 2024] Low rank memory efficient optimizer without SVD
  ☆30Updated 2 weeks ago
• katiekang1998 / reasoning_generalization
  ☆33Updated 6 months ago
• lucidrains / scaling-vin-pytorch
  Exploration into the Scaling Value Iteration Networks paper, from Schmidhuber's group
  ☆36Updated 9 months ago
• EleutherAI / rnngineering
  Engineering the state of RNN language models (Mamba, RWKV, etc.)
  ☆32Updated last year
• epfml / schedules-and-scaling
  Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"
  ☆75Updated 8 months ago
• ablghtianyi / ICL_Modular_Arithmetic
  ☆19Updated 3 months ago
• allenai / easy-to-hard-generalization
  Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"
  ☆48Updated last year
• kiddyboots216 / lottery-ticket-adaptation
  Lottery Ticket Adaptation
  ☆39Updated 7 months ago
• complex-reasoning / RPG
  The official implementation of Regularized Policy Gradient (RPG) (https://arxiv.org/abs/2505.17508)
  ☆35Updated last week
• vvvm23 / mamba-jax
  Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX
  ☆84Updated last year
• gregorbachmann / scaling_mlps
  ☆51Updated last year