Alternatives and similar repositories for structural-grokking:

Users that are interested in structural-grokking are comparing it to the libraries listed below

• abhishekpanigrahi1996 / transformer_in_transformer
  ☆44Updated last year
• nouhadziri / faith-and-fate
  ☆34Updated 10 months ago
• gregorbachmann / Next-Token-Failures
  ☆80Updated 11 months ago
• sjelassi / transformers_ssm_copy
  ☆30Updated 11 months ago
• abdulhaim / LMRL-Gym
  ☆79Updated 7 months ago
• NohTow / PPL-MCTS
  Repository for the code of the "PPL-MCTS: Constrained Textual Generation Through Discriminator-Guided Decoding" paper, NAACL'22
  ☆64Updated 2 years ago
• UFO-101 / auto-circuit
  A library for efficient patching and automatic circuit discovery.
  ☆53Updated this week
• janphilippfranken / sami
  Self-Supervised Alignment with Mutual Information
  ☆16Updated 8 months ago
• MurtyShikhar / Pushdown-Layers
  Code for Pushdown Layers from our EMNLP 2023 paper
  ☆27Updated last year
• dangxingyu / rnn-icrag
  Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"
  ☆25Updated 10 months ago
• linlu-qiu / lm-inductive-reasoning
  ☆30Updated last year
• HKUNLP / diffusion-vs-ar
  [ICLR 2025] Code for the paper "Beyond Autoregression: Discrete Diffusion for Complex Reasoning and Planning"
  ☆32Updated last week
• berlino / seq_icl
  ☆51Updated 9 months ago
• google-deepmind / emergent_in_context_learning
  ☆80Updated 6 months ago
• mukhal / grace
  [EMNLP 2023, Findings] GRACE: Discriminator-Guided Chain-of-Thought Reasoning
  ☆47Updated 4 months ago
• mega002 / ff-layers
  The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Le…
  ☆89Updated 3 years ago
• FranxYao / RDP
  Implementation of ICML 22 Paper: Scaling Structured Inference with Randomization
  ☆14Updated 2 years ago
• McGill-NLP / VinePPO
  Code for the paper "VinePPO: Unlocking RL Potential For LLM Reasoning Through Refined Credit Assignment"
  ☆121Updated 3 months ago
• allenai / easy-to-hard-generalization
  Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"
  ☆46Updated last year
• wellecks / naturalprover
  NaturalProver: Grounded Mathematical Proof Generation with Language Models
  ☆36Updated last year
• princeton-nlp / LM-Kernel-FT
  A Kernel-Based View of Language Model Fine-Tuning https://arxiv.org/abs/2210.05643
  ☆74Updated last year
• princeton-nlp / USACO
  Can Language Models Solve Olympiad Programming?
  ☆110Updated last month
• casmlab / NPHardEval
  Repository for NPHardEval, a quantified-dynamic benchmark of LLMs
  ☆52Updated 10 months ago
• XiangLi1999 / AutoBencher
  ☆26Updated 7 months ago
• google / belief-localization
  This repository includes code for the paper "Does Localization Inform Editing? Surprising Differences in Where Knowledge Is Stored vs. Ca…
  ☆59Updated last year
• HKUNLP / subgoal-theorem-prover
  Code for the paper "Decomposing the Enigma: Subgoal-based Demonstration Learning for Formal Theorem Proving"
  ☆17Updated last year
• Edward-Sun / gpt-accelera
  Simple and efficient pytorch-native transformer training and inference (batched)
  ☆68Updated 10 months ago
• wesg52 / universal-neurons
  Universal Neurons in GPT2 Language Models
  ☆27Updated 8 months ago
• ucl-dark / llm_debate
  Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"
  ☆100Updated 10 months ago
• haozheji / exact-optimization
  ICML 2024 - Official Repository for EXO: Towards Efficient Exact Optimization of Language Model Alignment
  ☆50Updated 8 months ago