rycolab / kl-rbLinks
This repository contains code for the paper "Better Estimation of the KL Divergence Between Language Models"
☆15Updated 7 months ago
Alternatives and similar repositories for kl-rb
Users that are interested in kl-rb are comparing it to the libraries listed below
Sorting:
- Codebase describing experiments in Truncation Sampling as Language Model Desmoothing☆13Updated 3 years ago
- CausalGym: Benchmarking causal interpretability methods on linguistic tasks☆51Updated last year
- Code for "Tracing Knowledge in Language Models Back to the Training Data"☆39Updated 3 years ago
- ☆29Updated last year
- A Toolkit for Distributional Control of Generative Models☆74Updated last month
- Landing page for MIB: A Mechanistic Interpretability Benchmark☆23Updated 5 months ago
- Code for our paper: "GrIPS: Gradient-free, Edit-based Instruction Search for Prompting Large Language Models"☆57Updated 2 years ago
- ☆114Updated 3 years ago
- A Python library that encapsulates various methods for neuron interpretation and analysis in Deep NLP models.☆106Updated 2 years ago
- Code repository for the paper "Mission: Impossible Language Models."☆56Updated 3 months ago
- This code accompanies the paper "Bayesian Framework for Information-Theoretic Probing" published in EMNLP 2021.☆10Updated 4 years ago
- The official repository for our paper "The Neural Data Router: Adaptive Control Flow in Transformers Improves Systematic Generalization".☆34Updated 7 months ago
- A Kernel-Based View of Language Model Fine-Tuning https://arxiv.org/abs/2210.05643☆78Updated 2 years ago
- Experiments and code to generate the GINC small-scale in-context learning dataset from "An Explanation for In-context Learning as Implici…☆106Updated 2 years ago
- ☆36Updated 3 years ago
- Minimum Bayes Risk Decoding for Hugging Face Transformers☆60Updated last year
- Easy-to-use MIRAGE code for faithful answer attribution in RAG applications. Paper: https://aclanthology.org/2024.emnlp-main.347/☆26Updated 10 months ago
- Simple and scalable tools for data-driven pretraining data selection.☆29Updated 7 months ago
- ☆24Updated 4 years ago
- Repo for ICML23 "Why do Nearest Neighbor Language Models Work?"☆59Updated 3 years ago
- Measuring the Mixing of Contextual Information in the Transformer☆34Updated 2 years ago
- The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Le…☆99Updated 4 years ago
- Benchmark API for Multidomain Language Modeling☆25Updated 3 years ago
- This is the official implementation for our ACL 2024 paper: "Causal Estimation of Memorisation Profiles".☆24Updated 9 months ago
- Replication code for "With Little Power Comes Great Responsibility"☆39Updated 5 years ago
- ☆14Updated 8 months ago
- ☆36Updated 2 years ago
- Code for NAACL 2022 paper "Reframing Human-AI Collaboration for Generating Free-Text Explanations"☆31Updated 2 years ago
- Source code for CoNLL 2021 paper by Huebner et al. 2021☆20Updated 2 years ago
- Codebase for running (conditional) probing experiments☆22Updated 3 years ago