AlexeyGB / batch-norm-helps-optimizationLinks
Reproduction of "How Does Batch Normalization Help Optimization?" paper
☆21Updated 6 years ago
Alternatives and similar repositories for batch-norm-helps-optimization
Users that are interested in batch-norm-helps-optimization are comparing it to the libraries listed below
Sorting:
- Learning recognition/segmentation models without end-to-end training. 40%-60% less GPU memory footprint. Same training time. Better perfo…☆90Updated 2 years ago
- [CVPR 2021] "The Lottery Tickets Hypothesis for Supervised and Self-supervised Pre-training in Computer Vision Models" Tianlong Chen, Jon…☆69Updated 2 years ago
- ☆31Updated 5 years ago
- This repository provides code for "On Interaction Between Augmentations and Corruptions in Natural Corruption Robustness".☆45Updated 2 years ago
- Code for ViTAS_Vision Transformer Architecture Search☆50Updated 3 years ago
- ReSSL: Relational Self-Supervised Learning with Weak Augmentation☆58Updated 3 years ago
- Seach Losses of our paper 'Loss Function Discovery for Object Detection via Convergence-Simulation Driven Search', accepted by ICLR 2021.☆56Updated 3 years ago
- released code for the paper: ISTA-NAS: Efficient and Consistent Neural Architecture Search by Sparse Coding☆31Updated 4 years ago
- The Official Implementation of the ICCV-2021 Paper: Semantically Coherent Out-of-Distribution Detection.☆70Updated 3 years ago
- Codes for Understanding Architectures Learnt by Cell-based Neural Architecture Search☆27Updated 5 years ago
- PyTorch implementation of Weighted Batch-Normalization layers☆37Updated 4 years ago
- [NeurIPS 2020] "Once-for-All Adversarial Training: In-Situ Tradeoff between Robustness and Accuracy for Free" by Haotao Wang*, Tianlong C…☆44Updated 3 years ago
- Bag of Instances Aggregation Boosts Self-supervised Distillation (ICLR 2022)☆33Updated 3 years ago
- (NeurIPS 2020 Workshop on SSL) Official Implementation of "MixCo: Mix-up Contrastive Learning for Visual Representation"☆58Updated 2 years ago
- An efficient implementation for ImageNet classification☆17Updated 4 years ago
- Implementation of Effective Sparsification of Neural Networks with Global Sparsity Constraint☆31Updated 3 years ago
- Implementation of paper "Do Wide and Deep Networks Learn the Same Things?"☆16Updated 3 years ago
- Direct Differentiable Augmentation Search☆14Updated 3 years ago
- Improving Contrastive Learning by Visualizing Feature Transformation, ICCV 2021 Oral☆90Updated 3 years ago
- Pytorch implementation of our paper accepted by TPAMI 2023 — Lottery Jackpots Exist in Pre-trained Models☆34Updated 2 years ago
- [CVPR 2020] Adversarial Robustness: From Self-Supervised Pre-Training to Fine-Tuning☆85Updated 3 years ago
- Automated Search for Resource-Efficient Branched Multi-Task Networks [BMVC 2020]☆15Updated last year
- CVPR2021: Out-of-Distribution Detection Using Union of 1-Dimensional Subspaces☆22Updated 3 years ago
- ☆35Updated 3 years ago
- ☆21Updated 5 years ago
- [NeurIPS 2020 Oral] Is normalization indispensable for training deep neural networks?☆34Updated 3 years ago
- Official Codes and Pretrained Models for RecursiveMix☆22Updated 2 years ago
- ☆48Updated 5 years ago
- [ICLR 2022]: Fast AdvProp☆35Updated 3 years ago
- Metrics for "Beyond neural scaling laws: beating power law scaling via data pruning " (NeurIPS 2022 Outstanding Paper Award)☆56Updated 2 years ago