Alternatives and similar repositories for structural-grokking:

Users that are interested in structural-grokking are comparing it to the libraries listed below

• nouhadziri / faith-and-fate
  ☆34Updated last year
• abhishekpanigrahi1996 / transformer_in_transformer
  ☆45Updated last year
• berlino / seq_icl
  ☆51Updated 10 months ago
• linlu-qiu / lm-inductive-reasoning
  ☆34Updated last year
• NohTow / PPL-MCTS
  Repository for the code of the "PPL-MCTS: Constrained Textual Generation Through Discriminator-Guided Decoding" paper, NAACL'22
  ☆64Updated 2 years ago
• sjelassi / transformers_ssm_copy
  ☆30Updated last year
• HKUNLP / diffusion-vs-ar
  [ICLR 2025] Code for the paper "Beyond Autoregression: Discrete Diffusion for Complex Reasoning and Planning"
  ☆45Updated last month
• shawntan / stickbreaking-attention
  Stick-breaking attention
  ☆49Updated 2 weeks ago
• MurtyShikhar / Pushdown-Layers
  Code for Pushdown Layers from our EMNLP 2023 paper
  ☆28Updated last year
• google / belief-localization
  This repository includes code for the paper "Does Localization Inform Editing? Surprising Differences in Where Knowledge Is Stored vs. Ca…
  ☆59Updated last year
• nathanhu0 / CaMeLS
  Codebase for Context-aware Meta-learned Loss Scaling (CaMeLS). https://arxiv.org/abs/2305.15076.
  ☆25Updated last year
• redwoodresearch / Easy-Transformer
  ☆114Updated 7 months ago
• google-deepmind / emergent_in_context_learning
  ☆81Updated 8 months ago
• janphilippfranken / sami
  Self-Supervised Alignment with Mutual Information
  ☆16Updated 10 months ago
• sustcsonglin / mamba-triton
  ☆47Updated last year
• Dahoas / QDSyntheticData
  ☆13Updated 7 months ago
• abdulhaim / LMRL-Gym
  ☆84Updated 9 months ago
• tommccoy1 / embers-of-autoregression
  ☆27Updated 3 months ago
• epfml / schedules-and-scaling
  Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"
  ☆71Updated 5 months ago
• ucl-dark / llm_debate
  Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"
  ☆103Updated last year
• HKUNLP / subgoal-theorem-prover
  Code for the paper "Decomposing the Enigma: Subgoal-based Demonstration Learning for Formal Theorem Proving"
  ☆18Updated last year
• mega002 / ff-layers
  The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Le…
  ☆90Updated 3 years ago
• Phylliida / MambaLens
  Mamba support for transformer lens
  ☆15Updated 6 months ago
• GSYfate / knnlm-limits
  Official code repo for paper "Great Memory, Shallow Reasoning: Limits of kNN-LMs"
  ☆22Updated 7 months ago
• wesg52 / universal-neurons
  Universal Neurons in GPT2 Language Models
  ☆27Updated 10 months ago
• tau-nlp / scrolls
  The official code of EMNLP 2022, "SCROLLS: Standardized CompaRison Over Long Language Sequences".
  ☆69Updated last year
• gregorbachmann / Next-Token-Failures
  ☆81Updated last year
• Edward-Sun / gpt-accelera
  Simple and efficient pytorch-native transformer training and inference (batched)
  ☆72Updated last year
• mukhal / grace
  [EMNLP 2023, Findings] GRACE: Discriminator-Guided Chain-of-Thought Reasoning
  ☆47Updated 5 months ago
• casmlab / NPHardEval
  Repository for NPHardEval, a quantified-dynamic benchmark of LLMs
  ☆52Updated last year