zaidalyafeai / AttentioNN
All about attention in neural networks. Soft attention, attention maps, local and global attention and multi-head attention.
☆231Updated 5 years ago
Alternatives and similar repositories for AttentioNN
Users that are interested in AttentioNN are comparing it to the libraries listed below
Sorting:
- A simpler version of the self-attention layer from SAGAN, and some image classification results.☆212Updated 5 years ago
- Source code for "On the Relationship between Self-Attention and Convolutional Layers"☆1,101Updated 2 years ago
- Experiments with supervised contrastive learning methods with different loss functions☆220Updated 2 years ago
- Keras implementation of Attention Augmented Convolutional Neural Networks☆121Updated 5 years ago
- Pytorch implementation of the paper "Class-Balanced Loss Based on Effective Number of Samples"☆797Updated last year
- Class-Balanced Loss Based on Effective Number of Samples. CVPR 2019☆609Updated 3 years ago
- pytorch implement of Lookahead Optimizer☆188Updated 2 years ago
- Implementing Attention Augmented Convolutional Networks using Pytorch☆652Updated 3 years ago
- lookahead optimizer (Lookahead Optimizer: k steps forward, 1 step back) for pytorch☆335Updated 5 years ago
- Unofficial PyTorch Implementation of Unsupervised Data Augmentation.☆147Updated 4 years ago
- Experiments with Adam/AdamW/amsgrad☆200Updated 6 years ago
- A curated list of resources about few-shot and one-shot learning☆282Updated 6 years ago
- Repo to build on / reproduce the record breaking Ranger-Mish-SelfAttention setup on FastAI ImageWoof dataset 5 epochs☆116Updated 5 years ago
- Multi heads attention for image classification☆81Updated 7 years ago
- A novel method for few shot learning☆52Updated 5 years ago
- Over9000 optimizer☆427Updated 2 years ago
- Pytorch Implementation of the paper MixMatch: A Holistic Approach to Semi-Supervised Learning (https://arxiv.org/pdf/1905.02249.pdf)☆123Updated 5 years ago
- Pytorch implementation for "Large-Scale Long-Tailed Recognition in an Open World" (CVPR 2019 ORAL)☆861Updated 2 years ago
- A PyTorch implementation of " EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks."☆313Updated 5 years ago
- ☆146Updated 3 years ago
- Multi-Task Learning Framework on PyTorch. State-of-the-art methods are implemented to effectively train models on multiple tasks.☆149Updated 5 years ago
- Scaling and Benchmarking Self-Supervised Visual Representation Learning☆586Updated 3 years ago
- Learning deep representations by mutual information estimation and maximization☆324Updated 6 years ago
- PyTorch Implementation of the paper Learning to Reweight Examples for Robust Deep Learning☆352Updated 6 years ago
- Implementation of the mixup training method☆466Updated 6 years ago
- Public repo for Augmented Multiscale Deep InfoMax representation learning☆400Updated 4 years ago
- Mish Deep Learning Activation Function for PyTorch / FastAI☆161Updated 5 years ago
- Code for Noisy Student Training. https://arxiv.org/abs/1911.04252☆761Updated 4 years ago
- High-level batteries-included neural network training library for Pytorch☆402Updated 3 years ago
- Code for "MixMatch - A Holistic Approach to Semi-Supervised Learning"☆647Updated last year