Alternatives and similar repositories for structural-grokking

Users that are interested in structural-grokking are comparing it to the libraries listed below

• nouhadziri / faith-and-fate
  ☆33Updated last year
• linlu-qiu / lm-inductive-reasoning
  ☆34Updated last year
• abhishekpanigrahi1996 / transformer_in_transformer
  ☆45Updated last year
• berlino / seq_icl
  ☆52Updated 11 months ago
• google / belief-localization
  This repository includes code for the paper "Does Localization Inform Editing? Surprising Differences in Where Knowledge Is Stored vs. Ca…
  ☆61Updated 2 years ago
• NohTow / PPL-MCTS
  Repository for the code of the "PPL-MCTS: Constrained Textual Generation Through Discriminator-Guided Decoding" paper, NAACL'22
  ☆65Updated 2 years ago
• MurtyShikhar / Pushdown-Layers
  Code for Pushdown Layers from our EMNLP 2023 paper
  ☆28Updated last year
• wesg52 / universal-neurons
  Universal Neurons in GPT2 Language Models
  ☆29Updated 11 months ago
• mega002 / ff-layers
  The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Le…
  ☆91Updated 3 years ago
• mechanistic-interpretability-grokking / progress-measures-paper
  ☆64Updated 2 years ago
• gregorbachmann / Next-Token-Failures
  ☆85Updated last year
• Dahoas / QDSyntheticData
  ☆13Updated 9 months ago
• wellecks / naturalprover
  NaturalProver: Grounded Mathematical Proof Generation with Language Models
  ☆37Updated 2 years ago
• xxxiaol / magic-if
  Source code and data for The Magic of IF: Investigating Causal Reasoning Abilities in Large Language Models of Code (Findings of ACL 2023…
  ☆29Updated last year
• msclar / symbolictom
  ☆21Updated last year
• HKUNLP / subgoal-theorem-prover
  Code for the paper "Decomposing the Enigma: Subgoal-based Demonstration Learning for Formal Theorem Proving"
  ☆19Updated last year
• princeton-nlp / LM-Kernel-FT
  A Kernel-Based View of Language Model Fine-Tuning https://arxiv.org/abs/2210.05643
  ☆76Updated last year
• qkaren / COLD_decoding
  ☆107Updated 2 years ago
• google-deepmind / emergent_in_context_learning
  ☆83Updated 9 months ago
• UFO-101 / auto-circuit
  A library for efficient patching and automatic circuit discovery.
  ☆64Updated 3 weeks ago
• aryamanarora / causalgym
  CausalGym: Benchmarking causal interpretability methods on linguistic tasks
  ☆42Updated 5 months ago
• epfl-dlab / understanding-decoding
  The data and the PyTorch implementation for the models and experiments in the paper "Language Model Decoding as Likelihood–Utility Alignm…
  ☆14Updated last year
• abdulhaim / LMRL-Gym
  ☆92Updated 10 months ago
• wellecks / lm-evaluation-harness
  A framework for few-shot evaluation of autoregressive language models.
  ☆24Updated last year
• felixzli / synthetic_pretraining
  ☆39Updated 2 years ago
• janphilippfranken / sami
  Self-Supervised Alignment with Mutual Information
  ☆18Updated 11 months ago
• FranxYao / Distributional-Generalization-in-Natural-Language-Processing
  Distributional Generalization in NLP. A roadmap.
  ☆88Updated 2 years ago
• casmlab / NPHardEval
  Repository for NPHardEval, a quantified-dynamic benchmark of LLMs
  ☆54Updated last year
• dangxingyu / rnn-icrag
  Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"
  ☆27Updated last year
• joshuacnf / paradox-learning2reason
  ☆34Updated 4 months ago