TristanThrush / perplexity-correlationsLinks
Simple and scalable tools for data-driven pretraining data selection.
☆24Updated 3 months ago
Alternatives and similar repositories for perplexity-correlations
Users that are interested in perplexity-correlations are comparing it to the libraries listed below
Sorting:
- Code for "Tracing Knowledge in Language Models Back to the Training Data"☆38Updated 2 years ago
- ☆25Updated 3 months ago
- ☆38Updated last year
- ☆20Updated 3 months ago
- Few-shot Learning with Auxiliary Data☆28Updated last year
- ☆72Updated last year
- This repository contains the code used for the experiments in the paper "Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity…☆26Updated last year
- Providing the answer to "How to do patching on all available SAEs on GPT-2?". It is an official repository of the implementation of the p…☆11Updated 4 months ago
- ☆29Updated 10 months ago
- ☆11Updated last year
- Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model☆43Updated last year
- ☆34Updated last year
- ☆44Updated 6 months ago
- ☆28Updated last year
- ☆35Updated 2 years ago
- Skill-It! A Data-Driven Skills Framework for Understanding and Training Language Models☆46Updated last year
- Official implementation of "BERTs are Generative In-Context Learners"☆28Updated 2 months ago
- ☆54Updated last year
- [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training☆21Updated 9 months ago
- A Kernel-Based View of Language Model Fine-Tuning https://arxiv.org/abs/2210.05643☆76Updated last year
- A library for efficient patching and automatic circuit discovery.☆65Updated last month
- Data and code for the preprint "In-Context Learning with Long-Context Models: An In-Depth Exploration"☆35Updated 9 months ago
- A library to create and manage configuration files, especially for machine learning projects.☆78Updated 3 years ago
- ☆51Updated last year
- Implementation of Influence Function approximations for differently sized ML models, using PyTorch☆15Updated last year
- ☆12Updated last year
- ☆52Updated last year
- Evaluate interpretability methods on localizing and disentangling concepts in LLMs.☆47Updated 8 months ago
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆75Updated 9 months ago
- Code release for Dataless Knowledge Fusion by Merging Weights of Language Models (https://openreview.net/forum?id=FCnohuR6AnM)☆89Updated last year