yashbonde / raspLinks
Implementing RASP transformer programming language https://arxiv.org/pdf/2106.06981.pdf.
☆59Updated 2 months ago
Alternatives and similar repositories for rasp
Users that are interested in rasp are comparing it to the libraries listed below
Sorting:
- An interactive exploration of Transformer programming.☆271Updated 2 years ago
- A domain-specific probabilistic programming language for modeling and inference with language models☆140Updated 8 months ago
- Learning Universal Predictors☆81Updated last year
- Language-annotated Abstraction and Reasoning Corpus☆99Updated 2 years ago
- ☆20Updated 2 years ago
- Train very large language models in Jax.☆210Updated 2 years ago
- Neural Networks and the Chomsky Hierarchy☆212Updated last year
- Named Tensors for Legible Deep Learning in JAX☆217Updated 2 months ago
- ☆551Updated last year
- An interpreter for RASP as described in the ICML 2021 paper "Thinking Like Transformers"☆323Updated last year
- seqax = sequence modeling + JAX☆170Updated 6 months ago
- Notebooks accompanying Anthropic's "Toy Models of Superposition" paper☆132Updated 3 years ago
- git extension for {collaborative, communal, continual} model development☆217Updated last year
- Inference code for LLaMA models in JAX☆120Updated last year
- Python library which enables complex compositions of language models such as scratchpads, chain of thought, tool use, selection-inference…☆216Updated last week
- Probabilistic programming with large language models☆157Updated 2 months ago
- Extract full next-token probabilities via language model APIs☆248Updated last year
- Tools for studying developmental interpretability in neural networks.☆124Updated 3 weeks ago
- Emergent world representations: Exploring a sequence model trained on a synthetic task☆199Updated 2 years ago
- ☆21Updated last year
- Materials for ConceptARC paper☆111Updated last year
- ☆289Updated last year
- LLM verified with Monte Carlo Tree Search☆284Updated 9 months ago
- LoRA for arbitrary JAX models and functions☆143Updated last year
- Swarm training framework using Haiku + JAX + Ray for layer parallel transformer language models on unreliable, heterogeneous nodes☆242Updated 2 years ago
- ☆76Updated last year
- Official repository for the paper "Can You Learn an Algorithm? Generalizing from Easy to Hard Problems with Recurrent Networks"☆61Updated 3 years ago
- Erasing concepts from neural representations with provable guarantees☆242Updated last year
- Scaling scaling laws with board games.☆53Updated 2 years ago
- Resources from the EleutherAI Math Reading Group☆54Updated 10 months ago