jxbz / entropix
📰 Computing the information content of trained neural networks
☆21Updated 3 years ago
Alternatives and similar repositories for entropix:
Users that are interested in entropix are comparing it to the libraries listed below
- Code for "Accelerating Training with Neuron Interaction and Nowcasting Networks" [to appear at ICLR 2025]☆18Updated last week
- ☆28Updated last year
- Minimum Description Length probing for neural network representations☆19Updated last month
- Repository for "GIST: Distributed training for large-scale graph convolutional networks"☆14Updated 2 years ago
- Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification☆11Updated last year
- PyTorch implementation for "Long Horizon Temperature Scaling", ICML 2023☆20Updated last year
- An attempt to merge ESBN with Transformers, to endow Transformers with the ability to emergently bind symbols☆15Updated 3 years ago
- ☆15Updated last year
- ☆22Updated 2 years ago
- ☆17Updated 2 years ago
- Investigate the speed of adaptation of structural causal models☆16Updated 4 years ago
- ☆18Updated 2 years ago
- Efficient Dictionary Learning with Switch Sparse Autoencoders (SAEs)☆21Updated 3 months ago
- Efficient Scaling laws and collaborative pretraining.☆15Updated last month
- Understanding how features learned by neural networks evolve throughout training☆33Updated 4 months ago
- Official code for the paper: "Metadata Archaeology"☆19Updated last year
- ☆26Updated last year
- The repository contains code for Adaptive Data Optimization☆20Updated 3 months ago
- Implements EvoNorms B0 and S0 as proposed in Evolving Normalization-Activation Layers.☆11Updated 4 years ago
- Experiments on GPT-3's ability to fit numerical models in-context.☆14Updated 2 years ago
- ☆9Updated last year
- Official Code for MIMETIC^2☆12Updated 4 months ago
- Latest Weight Averaging (NeurIPS HITY 2022)☆28Updated last year
- This repo contains code for the paper: "Can Foundation Models Help Us Achieve Perfect Secrecy?"☆24Updated 2 years ago
- PyTorch Implementation of the paper "MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training"☆23Updated this week
- Implementation of the models and datasets used in "An Information-theoretic Approach to Distribution Shifts"☆25Updated 3 years ago
- Aioli: A unified optimization framework for language model data mixing☆22Updated 2 months ago
- Simplifying parsing of large jsonline files in NLP Workflows☆12Updated 3 years ago
- ☆14Updated 4 months ago