Alternatives and similar repositories for grokking

Users that are interested in grokking are comparing it to the libraries listed below

• timaeus-research / devinterp
  Tools for studying developmental interpretability in neural networks.
  ☆124Updated last month
• TransformerLensOrg / CircuitsVis
  Mechanistic Interpretability Visualizations using React
  ☆318Updated last year
• google-deepmind / tracr
  ☆551Updated last year
• benchopt / benchopt
  Making your ML and optimization benchmarks simple and open
  ☆289Updated last week
• YuhangSong / Prospective-Configuration
  This repository contains the code for the paper "Inferring Neural Activity Before Plasticity: A Foundation for Learning Beyond Backpropag…
  ☆142Updated 2 years ago
• michaelhodel / re-arc
  Reverse Engineering the Abstraction and Reasoning Corpus
  ☆331Updated 11 months ago
• Prisma-Multimodal / ViT-Prisma
  ViT Prisma is a mechanistic interpretability library for Vision and Video Transformers (ViTs).
  ☆337Updated 6 months ago
• adamimos / epsilon-transformers
  epsilon machines and transformers!
  ☆34Updated 6 months ago
• srush / raspy
  An interactive exploration of Transformer programming.
  ☆271Updated 2 years ago
• Sohl-Dickstein / fractal
  The boundary of neural network trainability is fractal
  ☆221Updated last year
• fmohr / lcdb
  ☆15Updated last week
• probml / ssm-book
  Interactive textbook on state-space models
  ☆201Updated 2 years ago
• bremen79 / parameterfree
  Parameter-Free Optimizers for Pytorch
  ☆130Updated last year
• srush / annotated-s4
  Implementation of https://srush.github.io/annotated-s4
  ☆512Updated 7 months ago
• mechanistic-interpretability-grokking / progress-measures-paper
  ☆76Updated 3 years ago
• serre-lab / Lens
  LENS Project
  ☆52Updated last year
• aangelopoulos / ppi_py
  A package for statistically rigorous scientific discovery using machine learning. Implements prediction-powered inference.
  ☆272Updated 4 months ago
• bhoov / hamux
  Hierarchical Associative Memory User Experience
  ☆106Updated 2 weeks ago
• ArthurConmy / Automatic-Circuit-Discovery
  ☆265Updated last year
• ironjr / grokfast
  Official repository for the paper "Grokfast: Accelerated Grokking by Amplifying Slow Gradients"
  ☆573Updated last year
• KindXiaoming / BIMT
  Brain-Inspired Modular Training (BIMT), a method for making neural networks more modular and interpretable.
  ☆174Updated 2 years ago
• google-deepmind / neural_networks_chomsky_hierarchy
  Neural Networks and the Chomsky Hierarchy
  ☆212Updated last year
• neelnanda-io / 1L-Sparse-Autoencoder
  ☆132Updated 2 years ago
• EleutherAI / delphi
  Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …
  ☆238Updated this week
• PAIR-code / interpretability
  PAIR.withgoogle.com and friend's work on interpretability methods
  ☆219Updated last week
• saprmarks / dictionary_learning
  ☆387Updated 5 months ago
• stanfordnlp / pyvene
  Stanford NLP Python library for understanding and improving PyTorch models via interventions
  ☆854Updated this week
• callummcdougall / ARENA_2.0
  Resources for skilling up in AI alignment research engineering. Covers basics of deep learning, mechanistic interpretability, and RL.
  ☆238Updated 5 months ago
• ai-safety-foundation / sparse_autoencoder
  Sparse Autoencoder for Mechanistic Interpretability
  ☆289Updated last year
• apartresearch / interpretability-starter
  🧠 Starter templates for doing interpretability research
  ☆76Updated 2 years ago