EleutherAI / features-across-time
Understanding how features learned by neural networks evolve throughout training
☆34Updated 6 months ago
Alternatives and similar repositories for features-across-time:
Users that are interested in features-across-time are comparing it to the libraries listed below
- Minimum Description Length probing for neural network representations☆19Updated 2 months ago
- Stanford NLP Python library for benchmarking the utility of LLM interpretability methods☆70Updated 3 weeks ago
- Sparse and discrete interpretability tool for neural networks☆62Updated last year
- Efficient Scaling laws and collaborative pretraining.☆16Updated 2 months ago
- ☆67Updated 8 months ago
- ☆18Updated 9 months ago
- PyTorch implementation for "Long Horizon Temperature Scaling", ICML 2023☆20Updated last year
- Code for "Accelerating Training with Neuron Interaction and Nowcasting Networks" [to appear at ICLR 2025]☆18Updated last month
- Aioli: A unified optimization framework for language model data mixing☆23Updated 3 months ago
- ☆34Updated last year
- This repo is based on https://github.com/jiaweizzhao/GaLore☆26Updated 7 months ago
- Experiments for efforts to train a new and improved t5☆77Updated last year
- ☆31Updated 3 months ago
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆55Updated 7 months ago
- ☆21Updated 4 months ago
- ☆52Updated 6 months ago
- ☆36Updated last month
- Code and Data Repo for the CoNLL Paper -- Future Lens: Anticipating Subsequent Tokens from a Single Hidden State☆18Updated last year
- gzip Predicts Data-dependent Scaling Laws☆34Updated 10 months ago
- Code for reproducing our paper "Not All Language Model Features Are Linear"☆73Updated 4 months ago
- ☆90Updated 2 months ago
- Closed-form polynomial approximations to neural networks☆12Updated 2 months ago
- This repository includes code to reproduce the tables in "Loss Landscapes are All You Need: Neural Network Generalization Can Be Explaine…☆36Updated 2 years ago
- ☆78Updated 8 months ago
- ☆29Updated last year
- Google Research☆46Updated 2 years ago
- ☆48Updated last year
- ☆33Updated 7 months ago
- ☆49Updated last year
- Universal Neurons in GPT2 Language Models☆27Updated 10 months ago