Alternatives and similar repositories for structural-grokking

Users that are interested in structural-grokking are comparing it to the libraries listed below

• abhishekpanigrahi1996 / transformer_in_transformer
  ☆45Updated last year
• HKUNLP / subgoal-theorem-prover
  Code for the paper "Decomposing the Enigma: Subgoal-based Demonstration Learning for Formal Theorem Proving"
  ☆19Updated 2 years ago
• linlu-qiu / lm-inductive-reasoning
  ☆34Updated last year
• nouhadziri / faith-and-fate
  ☆34Updated last year
• gregorbachmann / Next-Token-Failures
  ☆86Updated last year
• janphilippfranken / sami
  Self-Supervised Alignment with Mutual Information
  ☆19Updated last year
• MurtyShikhar / Pushdown-Layers
  Code for Pushdown Layers from our EMNLP 2023 paper
  ☆28Updated last year
• berlino / seq_icl
  ☆53Updated last year
• wellecks / lm-evaluation-harness
  A framework for few-shot evaluation of autoregressive language models.
  ☆24Updated last year
• google-deepmind / emergent_in_context_learning
  ☆84Updated 10 months ago
• rosieyzh / openrlhf-pretrain
  Code for "Echo Chamber: RL Post-training Amplifies Behaviors Learned in Pretraining"
  ☆18Updated 2 months ago
• abdulhaim / LMRL-Gym
  ☆96Updated 11 months ago
• bergen / EdgeTransformer
  ☆22Updated 3 years ago
• upiterbarg / lintseq
  [ICLR 2025] "Training LMs on Synthetic Edit Sequences Improves Code Synthesis" (Piterbarg, Pinto, Fergus)
  ☆19Updated 4 months ago
• nathanhu0 / CaMeLS
  Codebase for Context-aware Meta-learned Loss Scaling (CaMeLS). https://arxiv.org/abs/2305.15076.
  ☆25Updated last year
• google / belief-localization
  This repository includes code for the paper "Does Localization Inform Editing? Surprising Differences in Where Knowledge Is Stored vs. Ca…
  ☆61Updated 2 years ago
• chang-github-00 / LLM-Predictive-Decoding
  ☆13Updated 7 months ago
• dangxingyu / rnn-icrag
  Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"
  ☆27Updated last year
• katiekang1998 / reasoning_generalization
  ☆32Updated 5 months ago
• jopetty / word-problem
  Experiments on the impact of depth in transformers and SSMs.
  ☆31Updated 7 months ago
• felixzli / synthetic_pretraining
  ☆39Updated 2 years ago
• microsoft / RLHF-APA
  RL algorithm: Advantage induced policy alignment
  ☆65Updated last year
• sjelassi / transformers_ssm_copy
  ☆32Updated last year
• xxxiaol / magic-if
  Source code and data for The Magic of IF: Investigating Causal Reasoning Abilities in Large Language Models of Code (Findings of ACL 2023…
  ☆29Updated 2 years ago
• Silent-Zebra / twisted-smc-lm
  ☆29Updated 3 months ago
• sustcsonglin / mamba-triton
  ☆48Updated last year
• ars22 / scaling-LLM-math-synthetic-data
  Code and data used in the paper: "Training on Incorrect Synthetic Data via RL Scales LLM Math Reasoning Eight-Fold"
  ☆30Updated last year
• epfml / schedules-and-scaling
  Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"
  ☆74Updated 7 months ago
• justinlovelace / Diffusion-Guided-LM
  ☆27Updated 10 months ago
• lee-ny / teaching_arithmetic
  ☆83Updated last year