leventsagun / hessian-for-basicDL
can calculate the Hessian matrix and/or its spectrum for simple neural nets
☆10Updated 6 years ago
Related projects: ⓘ
- This repo contains the code for the experiments in "Rademacher Complexity for Adversarially Robust Generalization"☆9Updated 5 years ago
- Implementation of SVRG and SAGA optimization algorithms for deep learning topics.☆68Updated 3 years ago
- Code for Global Convergence of Block Coordinate Descent in Deep Learning (ICML 2019)☆34Updated 5 years ago
- Certifying Some Distributional Robustness with Principled Adversarial Training (https://arxiv.org/abs/1710.10571)☆45Updated 6 years ago
- Code for the signSGD paper☆79Updated 3 years ago
- The code for the paper: https://arxiv.org/abs/1806.06317☆24Updated 5 years ago
- The Full Spectrum of Deepnet Hessians at Scale: Dynamics with SGD Training and Sample Size☆17Updated 5 years ago
- Adv-BNN: Improved Adversarial Defense through Robust Bayesian Neural Network☆61Updated 5 years ago
- Implementation of Minimax Pareto Fairness framework☆21Updated 4 years ago
- ☆13Updated 6 years ago
- Provable Robustness of ReLU networks via Maximization of Linear Regions [AISTATS 2019]☆31Updated 4 years ago
- Official implementation for Training Certifiably Robust Neural Networks with Efficient Local Lipschitz Bounds (NeurIPS, 2021).☆22Updated 2 years ago
- An (imperfect) implementation of wide resnets and Parseval regularization☆8Updated 4 years ago
- Randomized Smoothing of All Shapes and Sizes (ICML 2020).☆50Updated 4 years ago
- Implementation of MLP (python) and CNN (PyTorch) with Information Plane visualization.☆11Updated 6 years ago
- ☆29Updated 4 years ago
- PyTorch implementation of efficient algorithms for DRO with CVaR and Chi-Square uncertainty sets☆57Updated last year
- Decentralized SGD and Consensus with Communication Compression: https://arxiv.org/abs/1907.09356☆63Updated 4 years ago
- Distributional and Outlier Robust Optimization (ICML 2021)☆27Updated 3 years ago
- ☆26Updated last year
- Public code for a paper "Lipschitz-Margin Training: Scalable Certification of Perturbation Invariance for Deep Neural Networks."☆34Updated 5 years ago
- This repository demonstrates the application of our proposed task-free continual learning method on a synthetic experiment.☆13Updated 5 years ago
- Code for the paper "MMA Training: Direct Input Space Margin Maximization through Adversarial Training"☆34Updated 4 years ago
- Code release for the ICML 2019 paper "Are generative classifiers more robust to adversarial attacks?"☆23Updated 5 years ago
- Measurements of Three-Level Hierarchical Structure in the Outliers in the Spectrum of Deepnet Hessians (ICML 2019)☆17Updated 5 years ago
- Rethinking Bias-Variance Trade-off for Generalization of Neural Networks☆49Updated 3 years ago
- PyTorch implementation of FIM and empirical FIM☆57Updated 6 years ago
- Zeroth-order Min-max Optimization☆11Updated 4 years ago
- Federated posterior averaging implemented in JAX☆49Updated last year
- This repository is the implementation of Deep Dirichlet Process Mixture Models (UAI 2022)☆12Updated 2 years ago