science-of-finetuning / sparsity-artifacts-crosscodersLinks
Code for the "Overcoming Sparsity Artifacts in Crosscoders to Interpret Chat-Tuning" paper.
☆14Updated last month
Alternatives and similar repositories for sparsity-artifacts-crosscoders
Users that are interested in sparsity-artifacts-crosscoders are comparing it to the libraries listed below
Sorting:
- This repository contains the code used for the experiments in the paper "Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity…☆28Updated 3 weeks ago
- Code repo for the model organisms and convergent directions of EM papers.☆38Updated 2 months ago
- ☆110Updated 9 months ago
- ☆23Updated 9 months ago
- Code for my NeurIPS 2024 ATTRIB paper titled "Attribution Patching Outperforms Automated Circuit Discovery"☆42Updated last year
- Why Do We Need Weight Decay in Modern Deep Learning? [NeurIPS 2024]☆68Updated last year
- A library for efficient patching and automatic circuit discovery.☆80Updated 4 months ago
- Code for reproducing our paper "Not All Language Model Features Are Linear"☆84Updated 11 months ago
- Sparse Autoencoder Training Library☆55Updated 6 months ago
- ☆16Updated last year
- ☆104Updated last year
- ☆53Updated 10 months ago
- Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"☆85Updated last year
- Data for "Datamodels: Predicting Predictions with Training Data"☆97Updated 2 years ago
- Code Release for "Broken Neural Scaling Laws" (BNSL) paper☆59Updated 2 years ago
- Sparse and discrete interpretability tool for neural networks☆64Updated last year
- Self-Supervised Alignment with Mutual Information☆21Updated last year
- Official repository for our paper, Transformers Learn Higher-Order Optimization Methods for In-Context Learning: A Study with Linear Mode…☆19Updated last year
- ☆20Updated 2 weeks ago
- Evaluate interpretability methods on localizing and disentangling concepts in LLMs.☆56Updated 3 weeks ago
- Universal Neurons in GPT2 Language Models☆31Updated last year
- Stanford NLP Python library for benchmarking the utility of LLM interpretability methods☆141Updated 4 months ago
- ☆24Updated 11 months ago
- Gemstones: A Model Suite for Multi-Faceted Scaling Laws (NeurIPS 2025)☆29Updated last month
- Code for reproducing our paper "Low Rank Adapting Models for Sparse Autoencoder Features"☆17Updated 7 months ago
- Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)☆81Updated 2 years ago
- ☆94Updated last year
- ☆45Updated 2 years ago
- PyTorch library for Active Fine-Tuning☆95Updated last month
- Interpretating the latent space representations of attention head outputs for LLMs☆34Updated last year