tech-srl / RASP-expsLinks
Code for running the transformers in the ICML 2021 paper "Thinking Like Transformers"
☆18Updated 4 years ago
Alternatives and similar repositories for RASP-exps
Users that are interested in RASP-exps are comparing it to the libraries listed below
Sorting:
- An interactive exploration of Transformer programming.☆271Updated 2 years ago
- An interpreter for RASP as described in the ICML 2021 paper "Thinking Like Transformers"☆323Updated last year
- Language-annotated Abstraction and Reasoning Corpus☆99Updated 2 years ago
- Official repository for the paper "Can You Learn an Algorithm? Generalizing from Easy to Hard Problems with Recurrent Networks"☆61Updated 3 years ago
- Implementing RASP transformer programming language https://arxiv.org/pdf/2106.06981.pdf.☆59Updated 3 months ago
- Swarm training framework using Haiku + JAX + Ray for layer parallel transformer language models on unreliable, heterogeneous nodes☆242Updated 2 years ago
- Notebooks accompanying Anthropic's "Toy Models of Superposition" paper☆135Updated 3 years ago
- Mechanistic Interpretability for Transformer Models☆53Updated 3 years ago
- The Abstraction and Reasoning Corpus made into a web game☆90Updated last year
- A dataset of alignment research and code to reproduce it☆78Updated 2 years ago
- A library for bridging Python and HTML/Javascript (via Svelte) for creating interactive visualizations☆203Updated 4 years ago
- Erasing concepts from neural representations with provable guarantees☆243Updated last year
- See the issue board for the current status of active and prospective projects!☆65Updated 3 years ago
- Automatic gradient descent☆217Updated 2 years ago
- A programming language for formal/informal computation.☆43Updated last month
- A domain-specific probabilistic programming language for modeling and inference with language models☆141Updated 9 months ago
- gzip Predicts Data-dependent Scaling Laws☆34Updated last year
- Neural Networks and the Chomsky Hierarchy☆212Updated last year
- ☆138Updated last year
- Enjoy puzzle-solving directly in your browser.☆32Updated 9 months ago
- Utilities for the HuggingFace transformers library☆74Updated 3 years ago
- Train very large language models in Jax.☆210Updated 2 years ago
- unofficial re-implementation of "Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets"☆83Updated 3 years ago
- Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways - in Jax (Equinox framework)☆190Updated 3 years ago
- Code implementing "Efficient Parallelization of a Ubiquitious Sequential Computation" (Heinsen, 2023)☆98Updated last year
- Python library which enables complex compositions of language models such as scratchpads, chain of thought, tool use, selection-inference…☆216Updated 3 weeks ago
- Official repository for the paper "A Modern Self-Referential Weight Matrix That Learns to Modify Itself" (ICML 2022 & NeurIPS 2021 Deep R…☆175Updated 7 months ago
- Tools for working with the Abstraction & Reasoning Corpus☆215Updated 5 months ago
- ☆85Updated last year
- ☆60Updated 3 years ago