Alternatives and similar repositories for RASP:

Users that are interested in RASP are comparing it to the libraries listed below

• srush / raspy
  An interactive exploration of Transformer programming.
  ☆262Updated last year
• google-deepmind / tracr
  ☆530Updated last year
• google-deepmind / neural_networks_chomsky_hierarchy
  Neural Networks and the Chomsky Hierarchy
  ☆205Updated last year
• srush / do-we-need-attention
  ☆166Updated last year
• google-research / cascades
  Python library which enables complex compositions of language models such as scratchpads, chain of thought, tool use, selection-inference…
  ☆207Updated 3 months ago
• lucidrains / memorizing-transformers-pytorch
  Implementation of Memorizing Transformers (ICLR 2022), attention net augmented with indexing and retrieval of memories using approximate …
  ☆632Updated last year
• likenneth / othello_world
  Emergent world representations: Exploring a sequence model trained on a synthetic task
  ☆179Updated last year
• kingoflolz / swarm-jax
  Swarm training framework using Haiku + JAX + Ray for layer parallel transformer language models on unreliable, heterogeneous nodes
  ☆238Updated last year
• r-three / git-theta
  git extension for {collaborative, communal, continual} model development
  ☆210Updated 5 months ago
• facebookresearch / torchdim
  Named tensors with first-class dimensions for PyTorch
  ☆320Updated last year
• EleutherAI / project-menu
  See the issue board for the current status of active and prospective projects!
  ☆65Updated 3 years ago
• srush / Transformer-Puzzles
  Puzzles for exploring transformers
  ☆342Updated last year
• yashbonde / rasp
  Implementing RASP transformer programming language https://arxiv.org/pdf/2106.06981.pdf.
  ☆52Updated 3 years ago
• EleutherAI / concept-erasure
  Erasing concepts from neural representations with provable guarantees
  ☆227Updated 2 months ago
• stanford-crfm / levanter
  Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax
  ☆566Updated this week
• TransformerLensOrg / CircuitsVis
  Mechanistic Interpretability Visualizations using React
  ☆241Updated 4 months ago
• HazyResearch / H3
  Language Modeling with the H3 State Space Model
  ☆519Updated last year
• Sea-Snell / JAXSeq
  Train very large language models in Jax.
  ☆203Updated last year
• HomebrewML / revlib
  Simple and efficient RevNet-Library for PyTorch with XLA and DeepSpeed support and parameter offload
  ☆127Updated 2 years ago
• MatX-inc / seqax
  seqax = sequence modeling + JAX
  ☆153Updated last week
• anthropics / toy-models-of-superposition
  Notebooks accompanying Anthropic's "Toy Models of Superposition" paper
  ☆119Updated 2 years ago
• princeton-nlp / TransformerPrograms
  [NeurIPS 2023] Learning Transformer Programs
  ☆159Updated 10 months ago
• AlignmentResearch / tuned-lens
  Tools for understanding how transformer predictions are built layer-by-layer
  ☆485Updated 10 months ago
• HazyResearch / zoology
  Understand and test language model architectures on synthetic tasks.
  ☆191Updated last month
• victorvikram / ConceptARC
  Materials for ConceptARC paper
  ☆91Updated 5 months ago
• mechanistic-interpretability-grokking / progress-measures-paper
  ☆62Updated 2 years ago
• lucidrains / PaLM-jax
  Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways - in Jax (Equinox framework)
  ☆187Updated 2 years ago
• google-deepmind / transformer_grammars
  Transformer Grammars: Augmenting Transformer Language Models with Syntactic Inductive Biases at Scale, TACL (2022)
  ☆125Updated 5 months ago
• samacqua / LARC
  Language-annotated Abstraction and Reasoning Corpus
  ☆86Updated last year
• ayaka14732 / llama-2-jax
  JAX implementation of the Llama 2 model
  ☆218Updated last year