stevenliuyi / information-bottleneck
demonstration of the information bottleneck theory for deep learning
☆61Updated 7 years ago
Alternatives and similar repositories for information-bottleneck:
Users that are interested in information-bottleneck are comparing it to the libraries listed below
- ☆152Updated 5 years ago
- ☆66Updated 6 years ago
- Resources and Implementations (PyTorch) for Information Theoretical concepts in Deep Learning☆44Updated 6 years ago
- PyTorch implementation for the ICLR 2020 paper "Understanding the Limitations of Variational Mutual Information Estimators"☆74Updated 5 years ago
- This is the source code for Learning Deep Kernels for Non-Parametric Two-Sample Tests (ICML2020).☆49Updated 3 years ago
- ☆58Updated 2 years ago
- a python implementation of various versions of the information bottleneck, including automated parameter searching☆126Updated 4 years ago
- Explaining a black-box using Deep Variational Information Bottleneck Approach☆46Updated 2 years ago
- NTK reading group☆88Updated 5 years ago
- Sample code for running deterministic variational inference to train Bayesian neural networks☆100Updated 6 years ago
- Mutual Information Neural Entropic Estimation☆27Updated last year
- ☆89Updated 3 years ago
- Adv-BNN: Improved Adversarial Defense through Robust Bayesian Neural Network☆62Updated 5 years ago
- Pytorch Implementation of the Nonlinear Information Bottleneck☆39Updated 8 months ago
- Convolutional Neural Tangent Kernel☆111Updated 5 years ago
- Testing Nerual Tangent Kernel (NTK) on small UCI datasets☆83Updated 5 years ago
- Rethinking Bias-Variance Trade-off for Generalization of Neural Networks☆49Updated 4 years ago
- Code for Invariant Rep. Without Adversaries (NIPS 2018)☆35Updated 5 years ago
- Implementation of Invariant Risk Minimization https://arxiv.org/abs/1907.02893☆86Updated 5 years ago
- Collection of algorithms for approximating Fisher Information Matrix for Natural Gradient (and second order method in general)☆139Updated 5 years ago
- EDGE: Scalable and optimum mutual information estimator for high-dimensional applications including deep learning☆40Updated 2 years ago
- Code for the paper 'Understanding Measures of Uncertainty for Adversarial Example Detection'☆60Updated 6 years ago
- Approximate Inference Turns Deep Networks into Gaussian Processes (dnn2gp)☆48Updated 5 years ago
- Testing methods for estimating KL-divergence from samples.☆63Updated last month
- Code for paper: SDE-Net: Equipping Deep Neural network with Uncertainty Estimates☆113Updated 4 years ago
- explore DNNs via Infomration☆263Updated 5 years ago
- The codebase for the paper "A Tail-Index Analysis of Stochastic Gradient Noise in Deep Neural Networks"☆25Updated 5 years ago
- Cyclical Stochastic Gradient MCMC for Bayesian Deep Learning☆92Updated 4 years ago
- Analyze the dynamic stability of SGD☆12Updated 6 years ago
- Difference-of-Entropies (DoE) Estimator☆25Updated 3 years ago