tech-srl / RASP-expsLinks
Code for running the transformers in the ICML 2021 paper "Thinking Like Transformers"
☆18Updated 4 years ago
Alternatives and similar repositories for RASP-exps
Users that are interested in RASP-exps are comparing it to the libraries listed below
Sorting:
- An interactive exploration of Transformer programming.☆271Updated 2 years ago
- An interpreter for RASP as described in the ICML 2021 paper "Thinking Like Transformers"☆321Updated last year
- Implementing RASP transformer programming language https://arxiv.org/pdf/2106.06981.pdf.☆58Updated 2 weeks ago
- ☆73Updated 3 years ago
- A programming language for formal/informal computation.☆41Updated 3 months ago
- Language-annotated Abstraction and Reasoning Corpus☆94Updated 2 years ago
- Official repository for the paper "Can You Learn an Algorithm? Generalizing from Easy to Hard Problems with Recurrent Networks"☆59Updated 3 years ago
- Materials for ConceptARC paper☆105Updated last year
- ☆41Updated 3 years ago
- A dataset of alignment research and code to reproduce it☆78Updated 2 years ago
- Notebooks accompanying Anthropic's "Toy Models of Superposition" paper☆130Updated 3 years ago
- Neural Networks and the Chomsky Hierarchy☆211Updated last year
- Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways - in Jax (Equinox framework)☆188Updated 3 years ago
- Mechanistic Interpretability for Transformer Models☆53Updated 3 years ago
- Automatic gradient descent☆215Updated 2 years ago
- A library for bridging Python and HTML/Javascript (via Svelte) for creating interactive visualizations☆198Updated 3 years ago
- ☆138Updated last year
- A domain-specific probabilistic programming language for modeling and inference with language models☆137Updated 6 months ago
- Enjoy puzzle-solving directly in your browser.☆31Updated 6 months ago
- Official repository for the paper "A Modern Self-Referential Weight Matrix That Learns to Modify Itself" (ICML 2022 & NeurIPS 2021 Deep R…☆171Updated 5 months ago
- One stop shop for all things carp☆59Updated 3 years ago
- Swarm training framework using Haiku + JAX + Ray for layer parallel transformer language models on unreliable, heterogeneous nodes☆242Updated 2 years ago
- Named Tensors for Legible Deep Learning in JAX☆212Updated last week
- Train very large language models in Jax.☆210Updated 2 years ago
- gzip Predicts Data-dependent Scaling Laws☆34Updated last year
- LoRA for arbitrary JAX models and functions☆142Updated last year
- A pure-functional implementation of a machine learning transformer model in Python/JAX☆180Updated 6 months ago
- See the issue board for the current status of active and prospective projects!☆65Updated 3 years ago
- Python library which enables complex compositions of language models such as scratchpads, chain of thought, tool use, selection-inference…☆215Updated 5 months ago
- My writings about ARC (Abstraction and Reasoning Corpus)☆85Updated last week