Alternatives and similar repositories for structural-grokking:

Users that are interested in structural-grokking are comparing it to the libraries listed below

• nouhadziri / faith-and-fate
  ☆34Updated last year
• abhishekpanigrahi1996 / transformer_in_transformer
  ☆45Updated last year
• linlu-qiu / lm-inductive-reasoning
  ☆34Updated last year
• MurtyShikhar / Pushdown-Layers
  Code for Pushdown Layers from our EMNLP 2023 paper
  ☆28Updated last year
• NohTow / PPL-MCTS
  Repository for the code of the "PPL-MCTS: Constrained Textual Generation Through Discriminator-Guided Decoding" paper, NAACL'22
  ☆64Updated 2 years ago
• berlino / seq_icl
  ☆51Updated 10 months ago
• google-deepmind / emergent_in_context_learning
  ☆81Updated 8 months ago
• wellecks / lm-evaluation-harness
  A framework for few-shot evaluation of autoregressive language models.
  ☆24Updated last year
• HKUNLP / subgoal-theorem-prover
  Code for the paper "Decomposing the Enigma: Subgoal-based Demonstration Learning for Formal Theorem Proving"
  ☆18Updated last year
• HKUNLP / diffusion-vs-ar
  [ICLR 2025] Code for the paper "Beyond Autoregression: Discrete Diffusion for Complex Reasoning and Planning"
  ☆47Updated 2 months ago
• janphilippfranken / sami
  Self-Supervised Alignment with Mutual Information
  ☆16Updated 10 months ago
• abdulhaim / LMRL-Gym
  ☆90Updated 9 months ago
• gregorbachmann / Next-Token-Failures
  ☆82Updated last year
• casmlab / NPHardEval
  Repository for NPHardEval, a quantified-dynamic benchmark of LLMs
  ☆52Updated last year
• Edward-Sun / easy-to-hard
  Easy-to-Hard Generalization: Scalable Alignment Beyond Human Supervision
  ☆120Updated 7 months ago
• dangxingyu / rnn-icrag
  Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"
  ☆26Updated last year
• shawntan / stickbreaking-attention
  Stick-breaking attention
  ☆50Updated last month
• Dahoas / QDSyntheticData
  ☆13Updated 8 months ago
• nathanhu0 / CaMeLS
  Codebase for Context-aware Meta-learned Loss Scaling (CaMeLS). https://arxiv.org/abs/2305.15076.
  ☆25Updated last year
• McGill-NLP / VinePPO
  Code for the paper "VinePPO: Unlocking RL Potential For LLM Reasoning Through Refined Credit Assignment"
  ☆151Updated 5 months ago
• Edward-Sun / gpt-accelera
  Simple and efficient pytorch-native transformer training and inference (batched)
  ☆73Updated last year
• epfml / schedules-and-scaling
  Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"
  ☆71Updated 5 months ago
• wzq016 / PINE
  Offcial Repo of Paper "Eliminating Position Bias of Language Models: A Mechanistic Approach""
  ☆14Updated 7 months ago
• princeton-nlp / LM-Kernel-FT
  A Kernel-Based View of Language Model Fine-Tuning https://arxiv.org/abs/2210.05643
  ☆75Updated last year
• xxxiaol / magic-if
  Source code and data for The Magic of IF: Investigating Causal Reasoning Abilities in Large Language Models of Code (Findings of ACL 2023…
  ☆29Updated last year
• mandyyyyii / scibench
  ☆117Updated 9 months ago
• weigq / openview_quicklook
  ☆33Updated last month
• sustcsonglin / mamba-triton
  ☆46Updated last year
• allenai / easy-to-hard-generalization
  Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"
  ☆47Updated last year
• UFO-101 / auto-circuit
  A library for efficient patching and automatic circuit discovery.
  ☆62Updated 2 months ago