google-deepmind / neural_networks_chomsky_hierarchy
Neural Networks and the Chomsky Hierarchy
☆201Updated 10 months ago
Alternatives and similar repositories for neural_networks_chomsky_hierarchy:
Users that are interested in neural_networks_chomsky_hierarchy are comparing it to the libraries listed below
- unofficial re-implementation of "Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets"☆72Updated 2 years ago
- Emergent world representations: Exploring a sequence model trained on a synthetic task☆175Updated last year
- ☆253Updated 2 years ago
- Mechanistic Interpretability for Transformer Models☆49Updated 2 years ago
- Notebooks accompanying Anthropic's "Toy Models of Superposition" paper☆112Updated 2 years ago
- Resources from the EleutherAI Math Reading Group☆52Updated 2 months ago
- [NeurIPS 2023] Learning Transformer Programs☆157Updated 9 months ago
- Language-annotated Abstraction and Reasoning Corpus☆82Updated last year
- An interactive exploration of Transformer programming.☆258Updated last year
- An interpreter for RASP as described in the ICML 2021 paper "Thinking Like Transformers"☆301Updated 5 months ago
- Code accompanying our paper "Feature Learning in Infinite-Width Neural Networks" (https://arxiv.org/abs/2011.14522)☆59Updated 3 years ago
- ☆211Updated 7 months ago
- Tools for studying developmental interpretability in neural networks.☆84Updated 3 weeks ago
- ☆60Updated 2 years ago
- Brain-Inspired Modular Training (BIMT), a method for making neural networks more modular and interpretable.☆164Updated last year
- ☆109Updated 6 months ago
- Python library which enables complex compositions of language models such as scratchpads, chain of thought, tool use, selection-inference…☆202Updated last month
- ☆116Updated last year
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax☆545Updated this week
- ☆262Updated 11 months ago
- ☆165Updated last year
- Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways - in Jax (Equinox framework)☆186Updated 2 years ago
- Mechanistic Interpretability Visualizations using React☆232Updated 2 months ago
- Implementing RASP transformer programming language https://arxiv.org/pdf/2106.06981.pdf.☆46Updated 3 years ago
- ☆205Updated 4 months ago
- Transformer Grammars: Augmenting Transformer Language Models with Syntactic Inductive Biases at Scale, TACL (2022)☆122Updated 3 months ago
- Code Release for "Broken Neural Scaling Laws" (BNSL) paper☆58Updated last year
- A MAD laboratory to improve AI architecture designs 🧪☆103Updated 2 months ago
- Train very large language models in Jax.☆203Updated last year
- A domain-specific probabilistic programming language for modeling and inference with language models☆114Updated last year