TristanThrush / perplexity-correlations
Simple and scalable tools for data-driven pretraining data selection.
☆15Updated 2 weeks ago
Alternatives and similar repositories for perplexity-correlations:
Users that are interested in perplexity-correlations are comparing it to the libraries listed below
- A library for efficient patching and automatic circuit discovery.☆54Updated 2 weeks ago
- ☆64Updated 2 years ago
- Investigating the generalization behavior of LM probes trained to predict truth labels: (1) from one annotator to another, and (2) from e…☆26Updated 9 months ago
- This repository contains the code used for the experiments in the paper "Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity…☆23Updated 11 months ago
- ☆36Updated last year
- ☆19Updated this week
- ☆13Updated 2 weeks ago
- ☆46Updated last year
- ☆21Updated 5 months ago
- ☆28Updated 7 months ago
- ☆45Updated 6 months ago
- ☆17Updated 7 months ago
- Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"☆70Updated 4 months ago
- Is In-Context Learning Sufficient for Instruction Following in LLMs? [ICLR 2025]☆29Updated last month
- Source code of "Task arithmetic in the tangent space: Improved editing of pre-trained models".☆95Updated last year
- ☆58Updated this week
- Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)☆79Updated last year
- ☆12Updated 11 months ago
- Open source replication of Anthropic's Crosscoders for Model Diffing☆40Updated 4 months ago
- ☆51Updated 9 months ago
- ☆57Updated 3 months ago
- ☆37Updated last week
- This is the official repository for the "Towards Vision-Language Mechanistic Interpretability: A Causal Tracing Tool for BLIP" paper acce…☆19Updated 10 months ago
- Code for my NeurIPS 2024 ATTRIB paper titled "Attribution Patching Outperforms Automated Circuit Discovery"☆29Updated 9 months ago
- Evaluate interpretability methods on localizing and disentangling concepts in LLMs.☆38Updated 4 months ago
- Code and Data Repo for the CoNLL Paper -- Future Lens: Anticipating Subsequent Tokens from a Single Hidden State☆18Updated last year
- ☆35Updated 11 months ago
- ☆53Updated last year