catherinesyeh / attention-vizLinks
Visualizing query-key interactions in language + vision transformers
☆149Updated last year
Alternatives and similar repositories for attention-viz
Users that are interested in attention-viz are comparing it to the libraries listed below
Sorting:
- Extracting spatial and temporal world models from LLMs☆256Updated last year
- TART: A plug-and-play Transformer module for task-agnostic reasoning☆200Updated 2 years ago
- ☆101Updated 5 months ago
- Emergent world representations: Exploring a sequence model trained on a synthetic task☆182Updated 2 years ago
- Website for hosting the Open Foundation Models Cheat Sheet.☆267Updated 2 months ago
- ☆68Updated 10 months ago
- Erasing concepts from neural representations with provable guarantees☆230Updated 5 months ago
- ☆134Updated 3 months ago
- Notebooks accompanying Anthropic's "Toy Models of Superposition" paper☆127Updated 2 years ago
- Code to reproduce "Transformers Can Do Arithmetic with the Right Embeddings", McLeish et al (NeurIPS 2024)☆190Updated last year
- ☆39Updated last year
- Evaluating LLMs with CommonGen-Lite☆90Updated last year
- ☆166Updated 2 years ago
- Functional Benchmarks and the Reasoning Gap☆88Updated 9 months ago
- ☆124Updated 9 months ago
- ☆86Updated 6 months ago
- ☆150Updated last year
- A mechanistic approach for understanding and detecting factual errors of large language models.☆46Updated last year
- Implementation of 🌻 Mirasol, SOTA Multimodal Autoregressive model out of Google Deepmind, in Pytorch☆89Updated last year
- LLM-Merging: Building LLMs Efficiently through Merging☆201Updated 9 months ago
- ☆163Updated last year
- Implementation of CALM from the paper "LLM Augmented LLMs: Expanding Capabilities through Composition", out of Google Deepmind☆177Updated 10 months ago
- Sparse and discrete interpretability tool for neural networks☆63Updated last year
- ☆297Updated last year
- Code for reproducing our paper "Not All Language Model Features Are Linear"☆77Updated 7 months ago
- Discovering Data-driven Hypotheses in the Wild☆99Updated last month
- Datasets collection and preprocessings framework for NLP extreme multitask learning☆184Updated this week
- Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).☆206Updated 6 months ago
- RuLES: a benchmark for evaluating rule-following in language models☆227Updated 4 months ago
- Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …☆192Updated this week