EleutherAI / features-across-timeLinks
Understanding how features learned by neural networks evolve throughout training
☆41Updated last year
Alternatives and similar repositories for features-across-time
Users that are interested in features-across-time are comparing it to the libraries listed below
Sorting:
- ☆69Updated last year
- Minimum Description Length probing for neural network representations☆20Updated 11 months ago
- Sparse and discrete interpretability tool for neural networks☆64Updated last year
- Code Release for "Broken Neural Scaling Laws" (BNSL) paper☆59Updated 2 years ago
- Evaluation of neuro-symbolic engines☆40Updated last year
- Experiments for efforts to train a new and improved t5☆76Updated last year
- gzip Predicts Data-dependent Scaling Laws☆34Updated last year
- Codes and files for the paper Are Emergent Abilities in Large Language Models just In-Context Learning☆33Updated last year
- Google Research☆46Updated 3 years ago
- ☆112Updated 11 months ago
- Engineering the state of RNN language models (Mamba, RWKV, etc.)☆32Updated last year
- ☆24Updated last year
- ☆36Updated 3 years ago
- ☆28Updated 2 years ago
- This repository includes code to reproduce the tables in "Loss Landscapes are All You Need: Neural Network Generalization Can Be Explaine…☆40Updated 2 years ago
- Official implementation of "BERTs are Generative In-Context Learners"☆32Updated 10 months ago
- Official Repository of Pretraining Without Attention (BiGS), BiGS is the first model to achieve BERT-level transfer learning on the GLUE …☆116Updated last year
- ☆36Updated 2 years ago
- PyTorch library for Active Fine-Tuning☆96Updated 3 months ago
- Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"☆87Updated last year
- Yet another random morning idea to be quickly tried and architecture shared if it works; to allow the transformer to pause for any amount…☆53Updated 2 years ago
- Notebooks accompanying Anthropic's "Toy Models of Superposition" paper☆132Updated 3 years ago
- ☆53Updated last year
- Codebase for Context-aware Meta-learned Loss Scaling (CaMeLS). https://arxiv.org/abs/2305.15076.☆25Updated last year
- Code for reproducing our paper "Not All Language Model Features Are Linear"☆83Updated last year
- A centralized place for deep thinking code and experiments☆89Updated 2 years ago
- Implementation of Influence Function approximations for differently sized ML models, using PyTorch☆16Updated 2 years ago
- Automatically take good care of your preemptible TPUs☆37Updated 2 years ago
- Functional Benchmarks and the Reasoning Gap☆89Updated last year
- Code for PHATGOOSE introduced in "Learning to Route Among Specialized Experts for Zero-Shot Generalization"☆90Updated last year