adityashrm21 / information-theory-deep-learning

Related projects ⓘ

Alternatives and complementary repositories for information-theory-deep-learning

• stevenliuyi / information-bottleneck
  demonstration of the information bottleneck theory for deep learning
  ☆59Updated 7 years ago
• avirmaux / lipEstimation
  ☆57Updated last year
• mpezeshki / Gradient_Starvation
  Gradient Starvation: A Learning Proclivity in Neural Networks
  ☆60Updated 3 years ago
• js-d / sim_metric
  ☆35Updated last year
• RAIVNLab / supsup
  Code for "Supermasks in Superposition"
  ☆117Updated last year
• mfederici / dsit
  Implementation of the models and datasets used in "An Information-theoretic Approach to Distribution Shifts"
  ☆25Updated 3 years ago
• google-research / understanding-transfer-learning
  ☆43Updated 4 years ago
• gabrieleilertsen / nws
  Dissecting the weight space of neural networks
  ☆17Updated 3 years ago
• bobby-he / Neural_Tangent_Kernel
  ☆67Updated 5 years ago
• bneyshabur / over-parametrization
  Computing various norms/measures on over-parametrized neural networks
  ☆49Updated 5 years ago
• bamos / HowToTrainYourMAMLPytorch
  The original code for the paper "How to train your MAML" along with a replication of the original "Model Agnostic Meta Learning" (MAML) p…
  ☆40Updated 4 years ago
• thegregyang / NNspectra
  Computing the eigenvalues of Neural Tangent Kernel and Conjugate Kernel (aka NNGP kernel) over the boolean cube
  ☆47Updated 5 years ago
• AnonymousNIPS2019 / DeepnetHessian
  The Full Spectrum of Deepnet Hessians at Scale: Dynamics with SGD Training and Sample Size
  ☆17Updated 5 years ago
• StanfordASL / moca
  ☆31Updated 2 years ago
• alexalemi / vib_demo
  ☆87Updated 2 years ago
• yaodongyu / Rethink-BiasVariance-Tradeoff
  Rethinking Bias-Variance Trade-off for Generalization of Neural Networks
  ☆49Updated 3 years ago
• ermongroup / smile-mi-estimator
  PyTorch implementation for the ICLR 2020 paper "Understanding the Limitations of Variational Mutual Information Estimators"
  ☆73Updated 4 years ago
• automl / nes
  Neural Ensemble Search for Uncertainty Estimation and Dataset Shift
  ☆31Updated 7 months ago
• briancheung / superposition
  ☆45Updated 5 years ago
• litian96 / TERM
  Tilted Empirical Risk Minimization (ICLR '21)
  ☆59Updated last year
• IBM / online-alt-min
  Source code for paper Choromanska et al. -- Beyond Backprop: Online Alternating Minimization with Auxiliary Variables -- http://proceedin…
  ☆24Updated 5 years ago
• parthnatekar / pgdl
  Winning Solution of the NeurIPS 2020 Competition on Predicting Generalization in Deep Learning
  ☆39Updated 3 years ago
• sajadn / Exemplar-VAE
  Exemplar VAE: Linking Generative Models, Nearest Neighbor Retrieval, and Data Augmentation
  ☆69Updated 3 years ago
• moskomule / anatome
  Ἀνατομή is a PyTorch library to analyze representation of neural networks
  ☆62Updated last year
• burklight / nonlinear-IB-PyTorch
  Pytorch Implementation of the Nonlinear Information Bottleneck
  ☆37Updated 4 months ago
• wiseodd / last_layer_laplace
  Last-layer Laplace approximation code examples
  ☆81Updated 3 years ago
• yangarbiter / robust-local-lipschitz
  A Closer Look at Accuracy vs. Robustness
  ☆88Updated 3 years ago
• james-simon / eigenlearning
  codebase for "A Theory of the Inductive Bias and Generalization of Kernel Regression and Wide Neural Networks"
  ☆49Updated last year
• preetum / cifar5m
  CIFAR-5m dataset
  ☆39Updated 3 years ago
• facebookresearch / BalancingGroups
  Simple data balancing baselines for worst-group-accuracy benchmarks.
  ☆40Updated last year