harish-kamath / rqaeLinks
Residual Quantization Autoencoder, used for interpreting LLMs
☆13Updated last year
Alternatives and similar repositories for rqae
Users that are interested in rqae are comparing it to the libraries listed below
Sorting:
- Code and Data Repo for the CoNLL Paper -- Future Lens: Anticipating Subsequent Tokens from a Single Hidden State☆20Updated 2 months ago
- Minimum Description Length probing for neural network representations☆20Updated 11 months ago
- This repository contains the code used for the experiments in the paper "Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity…☆30Updated 2 months ago
- ☆53Updated last year
- ☆92Updated last month
- Understanding how features learned by neural networks evolve throughout training☆41Updated last year
- ☆36Updated 2 years ago
- ☆44Updated last year
- ☆38Updated last year
- ☆44Updated 4 years ago
- Code repo for the model organisms and convergent directions of EM papers.☆42Updated 4 months ago
- Repo for ICML23 "Why do Nearest Neighbor Language Models Work?"☆59Updated 3 years ago
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆78Updated last year
- Code for the note "NF4 Isn't Information Theoretically Optimal (and that's Good)☆21Updated 2 years ago
- A library to create and manage configuration files, especially for machine learning projects.☆79Updated 3 years ago
- Aioli: A unified optimization framework for language model data mixing☆32Updated last year
- Synthetic Data Generation for Evaluation☆13Updated 11 months ago
- Code Release for "Broken Neural Scaling Laws" (BNSL) paper☆59Updated 2 years ago
- LLM training in simple, raw C/CUDA☆15Updated last year
- ☆77Updated last year
- Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model☆45Updated 3 months ago
- Notebooks accompanying Anthropic's "Toy Models of Superposition" paper☆132Updated 3 years ago
- Sparse Autoencoder Training Library☆56Updated 8 months ago
- Repository for "I am a Strange Dataset: Metalinguistic Tests for Language Models"☆45Updated 2 years ago
- Implementation of Influence Function approximations for differently sized ML models, using PyTorch☆16Updated 2 years ago
- Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification☆11Updated 2 years ago
- Code for the ICLR 2024 paper "How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions"☆71Updated last year
- Replicating O1 inference-time scaling laws☆90Updated last year
- Experiments for efforts to train a new and improved t5☆76Updated last year
- PyTorch and NNsight implementation of AtP* (Kramar et al 2024, DeepMind)☆20Updated last year