Alternatives and similar repositories for Grokking:

Users that are interested in Grokking are comparing it to the libraries listed below

• callummcdougall / sae_visualizer
  ☆26Updated last year
• KhoomeiK / complexity-scaling
  gzip Predicts Data-dependent Scaling Laws
  ☆34Updated 10 months ago
• neelnanda-io / Neuroscope
  Accompanying codebase for neuroscope.io, a website for displaying max activating dataset examples for language model neurons
  ☆12Updated 2 years ago
• neelnanda-io / 1L-Sparse-Autoencoder
  ☆121Updated last year
• athms / mad-lab
  A MAD laboratory to improve AI architecture designs 🧪
  ☆111Updated 4 months ago
• bilal-chughtai / rep-theory-mech-interp
  ☆26Updated last year
• anthropics / toy-models-of-superposition
  Notebooks accompanying Anthropic's "Toy Models of Superposition" paper
  ☆120Updated 2 years ago
• steering-vectors / steering-vectors
  Steering vectors for transformer language models in Pytorch / Huggingface
  ☆95Updated 2 months ago
• Sea-Snell / grokking
  unofficial re-implementation of "Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets"
  ☆78Updated 2 years ago
• JoshEngels / MultiDimensionalFeatures
  Code for reproducing our paper "Not All Language Model Features Are Linear"
  ☆73Updated 4 months ago
• mechanistic-interpretability-grokking / progress-measures-paper
  ☆62Updated 2 years ago
• probcomp / LLaMPPL
  A domain-specific probabilistic programming language for modeling and inference with language models
  ☆126Updated last year
• Ping-C / optimizer
  This repository includes code to reproduce the tables in "Loss Landscapes are All You Need: Neural Network Generalization Can Be Explaine…
  ☆36Updated 2 years ago
• wesg52 / universal-neurons
  Universal Neurons in GPT2 Language Models
  ☆27Updated 10 months ago
• thestephencasper / everything-you-need
  we got you bro
  ☆35Updated 8 months ago
• EleutherAI / elk-generalization
  Investigating the generalization behavior of LM probes trained to predict truth labels: (1) from one annotator to another, and (2) from e…
  ☆26Updated 11 months ago
• berlino / seq_icl
  ☆51Updated 11 months ago
• LoryPack / LLM-LieDetector
  Code for the ICLR 2024 paper "How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions"
  ☆69Updated 10 months ago
• METR / RE-Bench
  ☆72Updated 2 months ago
• adamkarvonen / SAE_BoardGameEval
  ☆22Updated 2 months ago
• aadityasingh / icl-dynamics
  ☆19Updated last week
• google-deepmind / mishax
  ☆128Updated 3 weeks ago
• google-deepmind / neural_networks_solomonoff_induction
  Learning Universal Predictors
  ☆74Updated 8 months ago
• Silent-Zebra / twisted-smc-lm
  ☆28Updated 3 weeks ago
• mcleish7 / arithmetic
  Code to reproduce "Transformers Can Do Arithmetic with the Right Embeddings", McLeish et al (NeurIPS 2024)
  ☆189Updated 10 months ago
• redwoodresearch / interp
  Redwood Research's transformer interpretability tools
  ☆14Updated 3 years ago
• goodfire-ai / r1-interpretability
  Open source interpretability artefacts for R1.
  ☆82Updated this week
• taufeeque9 / codebook-features
  Sparse and discrete interpretability tool for neural networks
  ☆62Updated last year
• KihoPark / LLM_Categorical_Hierarchical_Representations
  ☆90Updated 2 months ago
• jbloomAus / SAEDashboard
  ☆36Updated last month