EsterHlav / Dynamical-Isometry-from-Orthogonality-Neural-NetsView external linksLinks
Mathematical consequences of orthogonal weights initialization and regularization in deep learning. Experiments with gain-adjusted orthogonal regularizer on RNNs with SeqMNIST dataset.
☆17Sep 21, 2019Updated 6 years ago
Alternatives and similar repositories for Dynamical-Isometry-from-Orthogonality-Neural-Nets
Users that are interested in Dynamical-Isometry-from-Orthogonality-Neural-Nets are comparing it to the libraries listed below
Sorting:
- Efficient Neural Network Loss Landscape Generation☆10Apr 26, 2019Updated 6 years ago
- This repository provides code source used in the paper: A Mean Field Theory of Quantized Deep Networks: The Quantization-Depth Trade-Off☆13May 30, 2019Updated 6 years ago
- Spell and pronounce words with a neural network☆10Feb 13, 2017Updated 9 years ago
- Official PyTorch implementation of the paper : ProbAct: A Probabilistic Activation Function for Deep Neural Networks.☆13Jun 10, 2019Updated 6 years ago
- Knowledge distillation from Ensembles of Iterative pruning (BMVC 2020)☆25Aug 13, 2020Updated 5 years ago
- Data-free knowledge distillation using Gaussian noise (NeurIPS paper)☆15Mar 24, 2023Updated 2 years ago
- Successfully training approximations to full-rank matrices for efficiency in deep learning.☆17Jan 5, 2021Updated 5 years ago
- All about acceleration and compression of Deep Neural Networks☆33Nov 5, 2019Updated 6 years ago
- The implementation of paper ''Efficient Attention Network: Accelerate Attention by Searching Where to Plug''.☆20Jun 16, 2023Updated 2 years ago
- Ensemble Knowledge Guided Sub-network Search and Fine-tuning for Filter Pruning☆19Sep 20, 2022Updated 3 years ago
- ☆16Feb 11, 2021Updated 5 years ago
- ☆19Jan 13, 2021Updated 5 years ago
- (Unofficial) Data-Distortion Guided Self-Distillation for Deep Neural Networks (AAAI 2019)☆14May 12, 2021Updated 4 years ago
- ☆20Nov 20, 2020Updated 5 years ago
- A collection of deep learning models (PyTorch implemtation)☆19Aug 30, 2024Updated last year
- PyTorch implementation of the paper The Lottery Ticket Hypothesis for Object Recognition☆23Apr 22, 2021Updated 4 years ago
- The official project website of "NORM: Knowledge Distillation via N-to-One Representation Matching" (The paper of NORM is published in IC…☆20Sep 18, 2023Updated 2 years ago
- Official PyTorch implementation for our ICCV 2019 paper - Fooling Network Interpretation in Image Classification☆24Nov 21, 2019Updated 6 years ago
- Implementation for <Regularizing Neural Networks via Minimizing Hyperspherical Energy> in CVPR'20.☆24Jun 23, 2020Updated 5 years ago
- TF-FD☆20Nov 19, 2022Updated 3 years ago
- A highly modular PyTorch framework with a focus on Neural Architecture Search (NAS).☆23Dec 3, 2021Updated 4 years ago
- Interpolation between Residual and Non-Residual Networks, ICML 2020. https://arxiv.org/abs/2006.05749☆26Aug 16, 2020Updated 5 years ago
- Code for the paper "Curriculum Dropout", ICCV 2017☆26May 2, 2018Updated 7 years ago
- Code for Active Mixup in 2020 CVPR☆23Jan 11, 2022Updated 4 years ago
- Explores the ideas presented in Deep Ensembles: A Loss Landscape Perspective (https://arxiv.org/abs/1912.02757) by Stanislav Fort, Huiyi …☆66Jul 29, 2020Updated 5 years ago
- Fine-grained ImageNet annotations☆30May 25, 2020Updated 5 years ago
- Pytorch implementation of the Deep Deterministic Policy Gradients for Continuous Control☆26Dec 8, 2022Updated 3 years ago
- SparseMax activation function implementation (ICML 2016) (PyTorch)☆28Nov 30, 2017Updated 8 years ago
- Pytorch version of "Deep Convolutional Networks as shallow Gaussian Processes" by Adrià Garriga-Alonso, Carl Rasmussen and Laurence Aitch…☆31Apr 16, 2020Updated 5 years ago
- An experimental compression pipeline for TensorFlow.☆27Jan 22, 2016Updated 10 years ago
- Lookahead: A Far-sighted Alternative of Magnitude-based Pruning (ICLR 2020)☆32Oct 25, 2020Updated 5 years ago
- Code for reproducing work of ICML 2019 paper: Memory-Optimal Direct Convolutions for Maximizing Classification Accuracy in Embedded Appli…☆12Jun 8, 2019Updated 6 years ago
- ☆10Updated this week
- [ICLR'23] Trainability Preserving Neural Pruning (PyTorch)☆34May 21, 2023Updated 2 years ago
- ☆12Jul 25, 2018Updated 7 years ago
- Implementation for our paper exploring a novel 2D adaptive attention span kernel in computer vision.☆35Oct 3, 2023Updated 2 years ago
- Source code for 'Knowledge Distillation via Instance Relationship Graph'☆30Jun 13, 2019Updated 6 years ago
- ShaResNet: reducing residual network parameter number by sharing weights☆32Mar 6, 2017Updated 8 years ago
- tensorflow implementation of Exploring Randomly Wired Neural Networks for Image Recognition☆32Dec 16, 2019Updated 6 years ago