samuelstanton / gnosis
Code to reproduce experiments from 'Does Knowledge Distillation Really Work' a paper which appeared in the 2021 NeurIPS proceedings.
☆32Updated last year
Related projects ⓘ
Alternatives and complementary repositories for gnosis
- Rethinking Bias-Variance Trade-off for Generalization of Neural Networks☆49Updated 3 years ago
- Towards Understanding Sharpness-Aware Minimization [ICML 2022]☆35Updated 2 years ago
- [CVPR 2021] "The Lottery Tickets Hypothesis for Supervised and Self-supervised Pre-training in Computer Vision Models" Tianlong Chen, Jon…☆68Updated last year
- Simple data balancing baselines for worst-group-accuracy benchmarks.☆40Updated last year
- CIFAR-5m dataset☆39Updated 3 years ago
- Gradient Starvation: A Learning Proclivity in Neural Networks☆60Updated 3 years ago
- ☆19Updated 3 years ago
- ☆15Updated last year
- [ICML2022] Training Your Sparse Neural Network Better with Any Mask. Ajay Jaiswal, Haoyu Ma, Tianlong Chen, ying Ding, and Zhangyang Wang☆26Updated 2 years ago
- Code for "Just Train Twice: Improving Group Robustness without Training Group Information"☆66Updated 5 months ago
- Official Implementation of Remembering for the Right Reasons (ICLR 2021)☆30Updated 3 years ago
- [JMLR] TRADES + random smoothing for certifiable robustness☆14Updated 4 years ago
- ☆38Updated 5 years ago
- Model Zoos for Continual Learning (ICLR 22)☆40Updated last year
- ☆58Updated last year
- Prospect Pruning: Finding Trainable Weights at Initialization Using Meta-Gradients☆30Updated 2 years ago
- Code for CVPR2021 paper: MOOD: Multi-level Out-of-distribution Detection☆38Updated last year
- ☆38Updated this week
- Official PyTorch implementation of the Fishr regularization for out-of-distribution generalization☆83Updated 2 years ago
- Offical Repo for Firefly Neural Architecture Descent: a General Approach for Growing Neural Networks. Accepted by Neurips 2020.☆29Updated 4 years ago
- Implementation of Effective Sparsification of Neural Networks with Global Sparsity Constraint☆28Updated 2 years ago
- PyTorch implementation of "Online Hyperparameter Optimization for Class-Incremental Learning" (AAAI 2023 Oral)☆17Updated last year
- Code for Sanity-Checking Pruning Methods: Random Tickets can Win the Jackpot☆43Updated 4 years ago
- Energy-Based Models for Continual Learning Official Repository (PyTorch)☆40Updated 2 years ago
- Pytorch implementation for "The Surprising Positive Knowledge Transfer in Continual 3D Object Shape Reconstruction"☆33Updated 2 years ago
- Official implementation of paper Gradient Matching for Domain Generalization☆116Updated 2 years ago
- Paper and Code for "Curriculum Learning by Optimizing Learning Dynamics" (AISTATS 2021)☆19Updated 3 years ago
- Last-layer Laplace approximation code examples☆80Updated 3 years ago
- Official Code Repository for La-MAML: Look-Ahead Meta-Learning for Continual Learning"☆72Updated 3 years ago
- Code to implement the AND-mask and geometric mean to do gradient based optimization, from the paper "Learning explanations that are hard …☆39Updated 3 years ago