Nix07 / finetuning
This repository contains the code used for the experiments in the paper "Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity Tracking".
☆21Updated 10 months ago
Alternatives and similar repositories for finetuning:
Users that are interested in finetuning are comparing it to the libraries listed below
- A library for efficient patching and automatic circuit discovery.☆48Updated 2 months ago
- Code and Data Repo for the CoNLL Paper -- Future Lens: Anticipating Subsequent Tokens from a Single Hidden State☆18Updated last year
- ☆75Updated 5 months ago
- Open source replication of Anthropic's Crosscoders for Model Diffing☆31Updated 3 months ago
- ☆43Updated 5 months ago
- Algebraic value editing in pretrained language models☆62Updated last year
- Steering Llama 2 with Contrastive Activation Addition☆119Updated 8 months ago
- Code for my NeurIPS 2024 ATTRIB paper titled "Attribution Patching Outperforms Automated Circuit Discovery"☆28Updated 7 months ago
- The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Le…☆89Updated 3 years ago
- ☆83Updated 11 months ago
- Code repository for the paper "Mission: Impossible Language Models."☆42Updated 2 weeks ago
- General-purpose activation steering library☆42Updated 3 weeks ago
- ☆27Updated 10 months ago
- ☆19Updated last year
- Code for "Tracing Knowledge in Language Models Back to the Training Data"☆37Updated 2 years ago
- ☆11Updated 7 months ago
- 👻 Code and benchmark for our EMNLP 2023 paper - "FANToM: A Benchmark for Stress-testing Machine Theory of Mind in Interactions"☆52Updated 7 months ago
- Code for reproducing our paper "Not All Language Model Features Are Linear"☆66Updated 2 months ago
- Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model☆42Updated last year
- ☆52Updated last year
- [NeurIPS 2024 Spotlight] Code and data for the paper "Finding Transformer Circuits with Edge Pruning".☆45Updated last month
- ☆54Updated 2 months ago
- CausalGym: Benchmarking causal interpretability methods on linguistic tasks☆40Updated last month
- ☆17Updated last month
- Investigating the generalization behavior of LM probes trained to predict truth labels: (1) from one annotator to another, and (2) from e…☆26Updated 8 months ago
- ☆31Updated last year
- Universal Neurons in GPT2 Language Models☆27Updated 8 months ago
- Function Vectors in Large Language Models (ICLR 2024)☆135Updated 3 months ago
- datasets from the paper "Towards Understanding Sycophancy in Language Models"☆67Updated last year
- ☆17Updated 3 months ago