stevenliuyi / information-bottleneck
demonstration of the information bottleneck theory for deep learning
☆61Updated 7 years ago
Alternatives and similar repositories for information-bottleneck:
Users that are interested in information-bottleneck are comparing it to the libraries listed below
- ☆151Updated 4 years ago
- a python implementation of various versions of the information bottleneck, including automated parameter searching☆123Updated 4 years ago
- Resources and Implementations (PyTorch) for Information Theoretical concepts in Deep Learning☆43Updated 6 years ago
- ☆67Updated 5 years ago
- Adv-BNN: Improved Adversarial Defense through Robust Bayesian Neural Network☆63Updated 5 years ago
- PyTorch implementation for the ICLR 2020 paper "Understanding the Limitations of Variational Mutual Information Estimators"☆74Updated 5 years ago
- Difference-of-Entropies (DoE) Estimator☆25Updated 2 years ago
- ☆58Updated last year
- ☆31Updated 2 years ago
- Collection of algorithms for approximating Fisher Information Matrix for Natural Gradient (and second order method in general)☆138Updated 5 years ago
- The codebase for the paper "A Tail-Index Analysis of Stochastic Gradient Noise in Deep Neural Networks"☆24Updated 5 years ago
- Implementation of Invariant Risk Minimization https://arxiv.org/abs/1907.02893☆85Updated 5 years ago
- This is the source code for Learning Deep Kernels for Non-Parametric Two-Sample Tests (ICML2020).☆48Updated 3 years ago
- Testing methods for estimating KL-divergence from samples.☆62Updated 11 months ago
- ☆89Updated 3 years ago
- Sample code for running deterministic variational inference to train Bayesian neural networks☆100Updated 6 years ago
- Explaining a black-box using Deep Variational Information Bottleneck Approach☆46Updated 2 years ago
- Pytorch Implementation of the Nonlinear Information Bottleneck☆39Updated 7 months ago
- PyTorch implementation of FIM and empirical FIM☆59Updated 6 years ago
- Code for Invariant Rep. Without Adversaries (NIPS 2018)☆35Updated 5 years ago
- Testing Nerual Tangent Kernel (NTK) on small UCI datasets☆83Updated 5 years ago
- ☆64Updated 4 years ago
- Code for paper: SDE-Net: Equipping Deep Neural network with Uncertainty Estimates☆109Updated 4 years ago
- Rethinking Bias-Variance Trade-off for Generalization of Neural Networks☆49Updated 4 years ago
- A variational inference method with accurate uncertainty estimation. It uses a new semi-implicit variational family built on neural netwo…☆53Updated 4 months ago
- Implementation of the variational continual learning method☆190Updated 5 years ago
- Convolutional Neural Tangent Kernel☆109Updated 5 years ago
- Approximate Inference Turns Deep Networks into Gaussian Processes (dnn2gp)☆48Updated 5 years ago
- The collection of recent papers about variational inference☆85Updated 5 years ago
- The HSIC Bottleneck: Deep Learning without Back-Propagation☆85Updated 4 years ago