wesg52 / universal-neurons
Universal Neurons in GPT2 Language Models
☆27Updated 9 months ago
Alternatives and similar repositories for universal-neurons:
Users that are interested in universal-neurons are comparing it to the libraries listed below
- ☆60Updated 3 months ago
- Open source replication of Anthropic's Crosscoders for Model Diffing☆44Updated 4 months ago
- ☆73Updated 6 months ago
- ☆51Updated 9 months ago
- Sparse Autoencoder Training Library☆42Updated 4 months ago
- Investigating the generalization behavior of LM probes trained to predict truth labels: (1) from one annotator to another, and (2) from e…☆26Updated 9 months ago
- Code for reproducing our paper "Not All Language Model Features Are Linear"☆70Updated 3 months ago
- Mamba support for transformer lens☆14Updated 5 months ago
- ☆88Updated last month
- A library for efficient patching and automatic circuit discovery.☆56Updated 3 weeks ago
- Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"☆71Updated 4 months ago
- ☆32Updated 2 weeks ago
- ☆44Updated last year
- This repository contains the code used for the experiments in the paper "Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity…☆25Updated 11 months ago
- ☆161Updated this week
- Code and Data Repo for the CoNLL Paper -- Future Lens: Anticipating Subsequent Tokens from a Single Hidden State☆18Updated last year
- ☆80Updated 7 months ago
- ☆21Updated last month
- Sparse probing paper full code.☆55Updated last year
- Language models scale reliably with over-training and on downstream tasks☆96Updated 11 months ago
- ☆18Updated last year
- Implementation of PaCE: Parsimonious Concept Engineering for Large Language Models (NeurIPS 2024)☆33Updated 4 months ago
- ☆31Updated 3 months ago
- The repository contains code for Adaptive Data Optimization☆20Updated 3 months ago
- ☆26Updated last year
- Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"☆26Updated 10 months ago
- ☆120Updated last year
- nanoGPT-like codebase for LLM training☆90Updated this week