TristanThrush / perplexity-correlations
Simple and scalable tools for data-driven pretraining data selection.
☆14Updated 2 weeks ago
Alternatives and similar repositories for perplexity-correlations:
Users that are interested in perplexity-correlations are comparing it to the libraries listed below
- ☆20Updated 4 months ago
- ☆12Updated 10 months ago
- ☆43Updated 5 months ago
- A library for efficient patching and automatic circuit discovery.☆48Updated 2 months ago
- ☆28Updated 6 months ago
- ☆62Updated 2 years ago
- Investigating the generalization behavior of LM probes trained to predict truth labels: (1) from one annotator to another, and (2) from e…☆26Updated 8 months ago
- Evaluate interpretability methods on localizing and disentangling concepts in LLMs.☆36Updated 3 months ago
- ☆26Updated 6 months ago
- This is the official repository for the "Towards Vision-Language Mechanistic Interpretability: A Causal Tracing Tool for BLIP" paper acce…☆18Updated 9 months ago
- ☆16Updated 6 months ago
- ☆34Updated last year
- This repository contains the code used for the experiments in the paper "Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity…☆21Updated 10 months ago
- ☆17Updated last month
- ☆29Updated 10 months ago
- Few-shot Learning with Auxiliary Data☆26Updated last year
- ☆34Updated 11 months ago
- ☆19Updated last year
- ☆31Updated last year
- Is In-Context Learning Sufficient for Instruction Following in LLMs? [ICLR 2025]☆29Updated this week
- Tasks for describing differences between text distributions.☆16Updated 5 months ago
- Function Vectors in Large Language Models (ICLR 2024)☆135Updated 3 months ago
- ☆46Updated last year
- ☆52Updated last year
- Implementation of paper 'Reversing the Forget-Retain Objectives: An Efficient LLM Unlearning Framework from Logit Difference' [NeurIPS'24…☆16Updated 7 months ago
- This repository includes code for the paper "Does Localization Inform Editing? Surprising Differences in Where Knowledge Is Stored vs. Ca…☆58Updated last year
- ☆75Updated 5 months ago
- ☆35Updated 2 years ago
- ☆61Updated last year
- A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.☆62Updated 2 months ago