epfml / attention-cnn
Source code for "On the Relationship between Self-Attention and Convolutional Layers"
☆1,098Updated 2 years ago
Alternatives and similar repositories for attention-cnn:
Users that are interested in attention-cnn are comparing it to the libraries listed below
- Implementing Stand-Alone Self-Attention in Vision Models using Pytorch☆455Updated 5 years ago
- Implementing Attention Augmented Convolutional Networks using Pytorch☆649Updated 3 years ago
- Code for Noisy Student Training. https://arxiv.org/abs/1911.04252☆759Updated 3 years ago
- Gradually-Warmup Learning Rate Scheduler for PyTorch☆987Updated 4 months ago
- Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less compute☆1,534Updated 4 years ago
- A PyTorch Implementation of Focal Loss.☆975Updated 5 years ago
- [arXiv 2019] "Contrastive Multiview Coding", also contains implementations for MoCo and InstDis☆1,314Updated 4 years ago
- mixup: Beyond Empirical Risk Minimization☆1,173Updated 3 years ago
- My best practice of training large dataset using PyTorch.☆1,092Updated 9 months ago
- An All-MLP solution for Vision, from Google AI☆1,015Updated 5 months ago
- Official Implementation of 'Fast AutoAugment' in PyTorch.☆1,602Updated 3 years ago
- Exploring Self-attention for Image Recognition, CVPR2020.☆751Updated 4 years ago
- Pytorch implementation of the paper "Class-Balanced Loss Based on Effective Number of Samples"☆791Updated last year
- Implementation of Bottleneck Transformer in Pytorch☆676Updated 3 years ago
- A New Optimization Technique for Deep Neural Networks☆535Updated 3 years ago
- [CVPR 2021] Involution: Inverting the Inherence of Convolution for Visual Recognition, a brand new neural operator☆1,309Updated 3 years ago
- Repository for NeurIPS 2020 Spotlight "AdaBelief Optimizer: Adapting stepsizes by the belief in observed gradients"☆1,060Updated 6 months ago
- PyTorch implementation of Contrastive Learning methods☆1,961Updated last year
- list of efficient attention modules☆995Updated 3 years ago
- A CV toolkit for my papers.☆2,048Updated 2 months ago
- Ranger - a synergistic optimizer using RAdam (Rectified Adam), Gradient Centralization and LookAhead in one codebase☆1,196Updated last year
- This repository reproduces the results of the paper: "Fixing the train-test resolution discrepancy" https://arxiv.org/abs/1906.06423☆1,038Updated 3 years ago
- a pytorch code about Residual Attention Network. This code is based on two projects from☆682Updated 6 years ago
- Official PyTorch Repo for "ReZero is All You Need: Fast Convergence at Large Depth"☆407Updated 7 months ago
- Implementation of DropBlock: A regularization method for convolutional networks in PyTorch.☆592Updated 4 years ago
- Debug PyTorch code using PySnooper☆799Updated 3 years ago
- ICCV2021, Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNet☆1,179Updated last year
- Official PyTorch code for "BAM: Bottleneck Attention Module (BMVC2018)" and "CBAM: Convolutional Block Attention Module (ECCV2018)"☆2,111Updated last year
- Official Pytorch implementation of CutMix regularizer☆1,227Updated 4 years ago
- An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale☆292Updated 3 years ago