dilinwang820 / fast-energy-aware-splitting
Energy-Aware Neural Architecture Optimization with Fast Splitting Steepest Descent
☆13Updated 5 years ago
Alternatives and similar repositories for fast-energy-aware-splitting:
Users that are interested in fast-energy-aware-splitting are comparing it to the libraries listed below
- Code accompanying our paper "Finding trainable sparse networks through Neural Tangent Transfer" to be published at ICML-2020.☆13Updated 4 years ago
- SmoothOut: Smoothing Out Sharp Minima to Improve Generalization in Deep Learning☆23Updated 6 years ago
- ☆34Updated 3 years ago
- Offical Repo for Splitting Steepest Descent for Growing Neural Architectures☆12Updated 3 years ago
- Estimating Gradients for Discrete Random Variables by Sampling without Replacement☆40Updated 5 years ago
- [JMLR] TRADES + random smoothing for certifiable robustness☆14Updated 4 years ago
- TensorFlow implementation of "noisy K-FAC" and "noisy EK-FAC".☆60Updated 6 years ago
- This repo contains the code used for NeurIPS 2019 paper "Asymmetric Valleys: Beyond Sharp and Flat Local Minima".☆14Updated 5 years ago
- Code base for SRSGD.☆28Updated 4 years ago
- Encodings for neural architecture search☆29Updated 3 years ago
- The Full Spectrum of Deepnet Hessians at Scale: Dynamics with SGD Training and Sample Size☆17Updated 5 years ago
- Computing various norms/measures on over-parametrized neural networks☆49Updated 6 years ago
- Local search for NAS☆18Updated 4 years ago
- Implementation of Information Dropout☆39Updated 7 years ago
- A pytorch implementation for the LSTM experiments in the paper: Why Gradient Clipping Accelerates Training: A Theoretical Justification f…☆44Updated 5 years ago
- Low-variance, efficient and unbiased gradient estimation for optimizing models with binary latent variables. (ICLR 2019)☆28Updated 5 years ago
- Geometric Certifications of Neural Nets☆41Updated 2 years ago
- Code for Stochastic Hyperparameter Optimization through Hypernetworks☆23Updated 6 years ago
- SGD and Ordered SGD codes for deep learning, SVM, and logistic regression☆35Updated 4 years ago
- Official code for "In Search of Robust Measures of Generalization" (NeurIPS 2020)☆28Updated 4 years ago
- Code to implement the AND-mask and geometric mean to do gradient based optimization, from the paper "Learning explanations that are hard …☆39Updated 4 years ago
- ☆20Updated 4 years ago
- Implementation of the Functional Neural Process models☆43Updated 4 years ago
- Code for Self-Tuning Networks (ICLR 2019) https://arxiv.org/abs/1903.03088☆53Updated 5 years ago
- ☆27Updated 6 years ago
- Public Codebase for Rethinking Parameter Counting: Effective Dimensionality Revisited☆37Updated 2 years ago
- Toy datasets to evaluate algorithms for domain generalization and invariance learning.☆42Updated 3 years ago
- Code for Sanity-Checking Pruning Methods: Random Tickets can Win the Jackpot☆42Updated 4 years ago
- Code accompanying the NeurIPS 2020 paper: WoodFisher (Singh & Alistarh, 2020)☆48Updated 3 years ago
- ☆34Updated 3 years ago