anzeyimana / Pytorch-PCGrad-GradVac-AMP-GradAccumLinks
PyTorch 1.11 reimplementation of multi task gradient adaptation ideas: Gradient Surgery (PCGrad) and Gradient Vaccine
☆18Updated 3 years ago
Alternatives and similar repositories for Pytorch-PCGrad-GradVac-AMP-GradAccum
Users that are interested in Pytorch-PCGrad-GradVac-AMP-GradAccum are comparing it to the libraries listed below
Sorting:
- Official implementation of "Multi-Task Learning as a Bargaining Game" [ICML 2022]☆225Updated last year
- Pytorch reimplementation for "Gradient Surgery for Multi-Task Learning"☆348Updated 4 years ago
- (Pytorch) Training ResNets on ImageNet-100 data☆60Updated 3 years ago
- [NeurIPS'22] This is an official implementation for "Scaling & Shifting Your Features: A New Baseline for Efficient Model Tuning".☆182Updated last year
- AdaShare: Learning What To Share For Efficient Deep Multi-Task Learning☆112Updated 4 years ago
- A pytorch implementation of paper 'Be Your Own Teacher: Improve the Performance of Convolutional Neural Networks via Self Distillation', …☆178Updated 3 years ago
- [CVPR 2023] This repository includes the official implementation our paper "Masked Autoencoders Enable Efficient Knowledge Distillers"☆106Updated last year
- Reproduce CKA: Similarity of Neural Network Representations Revisited☆304Updated 5 years ago
- [NeurIPS 2022] Make Sharpness-Aware Minimization Stronger: A Sparsified Perturbation Approach -- Official Implementation☆44Updated last year
- Official implementation for (Show, Attend and Distill: Knowledge Distillation via Attention-based Feature Matching, AAAI-2021)☆117Updated 4 years ago
- Co^2L: Contrastive Continual Learning (ICCV2021)☆96Updated 3 years ago
- Code for Finetune like you pretrain: Improved finetuning of zero-shot vision models☆100Updated last year
- [ICLR 2021 Spotlight] Code release for "Long-tailed Recognition by Routing Diverse Distribution-Aware Experts."☆272Updated 2 years ago
- Use lmdb to speed up imagenet dataset☆100Updated 4 years ago
- Official PyTorch implementation of "Co-Mixup: Saliency Guided Joint Mixup with Supermodular Diversity" (ICLR'21 Oral)☆103Updated 3 years ago
- Official PyTorch Implementation for Conflict-Averse Gradient Descent (CAGrad)☆124Updated last year
- Domain Generalization with MixStyle (ICLR'21)☆300Updated 2 years ago
- PyTorch custom dataset APIs -- CUB-200-2011, Stanford Dogs, Stanford Cars, FGVC Aircraft, NABirds, Tiny ImageNet, iNaturalist2017☆156Updated 2 years ago
- PyTorch implementation of "Bootstrap Your Own Latent: A New Approach to Self-Supervised Learning" with DDP and Apex AMP☆81Updated 4 years ago
- CLEAR benchmark (NeurIPS 2021 Dataset & Benchmark)☆26Updated 2 years ago
- Official repository for "Intriguing Properties of Vision Transformers" (NeurIPS 2021--Spotlight)☆176Updated 2 years ago
- Code and pretrained models for paper: Data-Free Adversarial Distillation☆99Updated 2 years ago
- ImageNet-R(endition) and DeepAugment (ICCV 2021)☆267Updated 3 years ago
- Efficient Dataset Distillation by Representative Matching☆113Updated last year
- The Implementation of "Auto-Lambda: Disentangling Dynamic Task Relationships" [TMLR 2022].☆135Updated 2 years ago
- ICLR 2021 i-Mix: A Domain-Agnostic Strategy for Contrastive Representation Learning☆78Updated last year
- Metrics for "Beyond neural scaling laws: beating power law scaling via data pruning " (NeurIPS 2022 Outstanding Paper Award)☆56Updated 2 years ago
- [CVPR-22] This is the official implementation of the paper "Adavit: Adaptive vision transformers for efficient image recognition".☆54Updated 2 years ago
- Distilling Dataset into Generative Models☆53Updated 2 years ago
- Official repo for PAC-Bayes Information Bottleneck. ICLR 2022.☆49Updated 3 years ago