tech-srl / RASP-expsLinks
Code for running the transformers in the ICML 2021 paper "Thinking Like Transformers"
☆18Updated 4 years ago
Alternatives and similar repositories for RASP-exps
Users that are interested in RASP-exps are comparing it to the libraries listed below
Sorting:
- An interpreter for RASP as described in the ICML 2021 paper "Thinking Like Transformers"☆320Updated last year
- An interactive exploration of Transformer programming.☆269Updated last year
- Language-annotated Abstraction and Reasoning Corpus☆93Updated 2 years ago
- The Abstraction and Reasoning Corpus made into a web game☆90Updated last year
- Implementing RASP transformer programming language https://arxiv.org/pdf/2106.06981.pdf.☆58Updated 4 years ago
- Official repository for the paper "A Modern Self-Referential Weight Matrix That Learns to Modify Itself" (ICML 2022 & NeurIPS 2021 Deep R…☆172Updated 4 months ago
- Notebooks accompanying Anthropic's "Toy Models of Superposition" paper☆129Updated 3 years ago
- Mechanistic Interpretability for Transformer Models☆53Updated 3 years ago
- ☆73Updated 3 years ago
- Swarm training framework using Haiku + JAX + Ray for layer parallel transformer language models on unreliable, heterogeneous nodes☆241Updated 2 years ago
- Automatic gradient descent☆213Updated 2 years ago
- Python library which enables complex compositions of language models such as scratchpads, chain of thought, tool use, selection-inference…☆213Updated 4 months ago
- Neural Networks and the Chomsky Hierarchy☆209Updated last year
- Official repository for the paper "Can You Learn an Algorithm? Generalizing from Easy to Hard Problems with Recurrent Networks"☆59Updated 3 years ago
- See the issue board for the current status of active and prospective projects!☆65Updated 3 years ago
- A library for bridging Python and HTML/Javascript (via Svelte) for creating interactive visualizations☆199Updated 3 years ago
- Emergent world representations: Exploring a sequence model trained on a synthetic task☆191Updated 2 years ago
- ☆41Updated 3 years ago
- Erasing concepts from neural representations with provable guarantees☆236Updated 8 months ago
- Learning Universal Predictors☆79Updated last year
- unofficial re-implementation of "Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets"☆79Updated 3 years ago
- One stop shop for all things carp☆59Updated 3 years ago
- The history files when recording human interaction while solving ARC tasks☆116Updated last week
- Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways - in Jax (Equinox framework)☆188Updated 3 years ago
- A programming language for formal/informal computation.☆41Updated 2 months ago
- Materials for ConceptARC paper☆102Updated 11 months ago
- A dataset of alignment research and code to reproduce it☆77Updated 2 years ago
- Keeping language models honest by directly eliciting knowledge encoded in their activations.☆208Updated last week
- A case study of efficient training of large language models using commodity hardware.☆68Updated 3 years ago
- minGPT in JAX☆48Updated 3 years ago