understanding-search / maze-transformer
This repo is built to facilitate the training and analysis of autoregressive transformers on maze-solving tasks.
☆27Updated 8 months ago
Alternatives and similar repositories for maze-transformer:
Users that are interested in maze-transformer are comparing it to the libraries listed below
- Interpreting how transformers simulate agents performing RL tasks☆80Updated last year
- Code for "Evidence of Learned Look-Ahead in a Chess-Playing Neural Network"☆21Updated 11 months ago
- maze datasets for investigating OOD behavior of ML systems☆41Updated 2 weeks ago
- ☆26Updated 2 years ago
- Universal Neurons in GPT2 Language Models☆28Updated 11 months ago
- PyTorch and NNsight implementation of AtP* (Kramar et al 2024, DeepMind)☆18Updated 3 months ago
- unofficial re-implementation of "Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets"☆78Updated 2 years ago
- Sparse Autoencoder Training Library☆49Updated last week
- ☆13Updated 9 months ago
- A collection of meta-learning algorithms in Jax☆23Updated 2 years ago
- ☆27Updated last year
- Scaling scaling laws with board games.☆48Updated last year
- A Mechanistic Interpretability Analysis of Grokking☆21Updated 2 years ago
- ☆38Updated this week
- Tools for studying developmental interpretability in neural networks.☆89Updated 3 months ago
- Improving Steering Vectors by Targeting Sparse Autoencoder Features☆19Updated 5 months ago
- ☆16Updated 5 months ago
- An Open-Ended Agentic Simulator☆48Updated 8 months ago
- Code for the paper "Function-Space Learning Rates"☆19Updated 3 weeks ago
- ☆49Updated last year
- Latent Program Network (from the "Searching Latent Program Spaces" paper)☆82Updated last month
- Minimal but scalable implementation of large language models in JAX☆34Updated 6 months ago
- A library for bridging Python and HTML/Javascript (via Svelte) for creating interactive visualizations☆14Updated last year
- ☆20Updated 2 years ago
- Redwood Research's transformer interpretability tools☆14Updated 3 years ago
- Deep Networks Grok All the Time and Here is Why☆34Updated 11 months ago
- ☆17Updated last year
- Official implementation of the transformer (TF) architecture suggested in a paper entitled "Looped Transformers as Programmable Computers…☆25Updated 2 years ago
- Investigating the generalization behavior of LM probes trained to predict truth labels: (1) from one annotator to another, and (2) from e…☆26Updated 11 months ago
- TPU pod commander is a package for managing and launching jobs on Google Cloud TPU pods.☆20Updated 10 months ago