zaidalyafeai / AttentioNN
All about attention in neural networks. Soft attention, attention maps, local and global attention and multi-head attention.
☆228Updated 4 years ago
Related projects ⓘ
Alternatives and complementary repositories for AttentioNN
- A simpler version of the self-attention layer from SAGAN, and some image classification results.☆212Updated 5 years ago
- Implementations for a family of attention mechanisms, suitable for all kinds of natural language processing tasks and compatible with Ten…☆347Updated 9 months ago
- Multi heads attention for image classification☆81Updated 6 years ago
- Keras implementation of Attention Augmented Convolutional Neural Networks☆121Updated 4 years ago
- Source code for "On the Relationship between Self-Attention and Convolutional Layers"☆1,086Updated last year
- Repo to build on / reproduce the record breaking Ranger-Mish-SelfAttention setup on FastAI ImageWoof dataset 5 epochs☆116Updated 5 years ago
- Experiments with supervised contrastive learning methods with different loss functions☆216Updated last year
- Implementing Attention Augmented Convolutional Networks using Pytorch☆642Updated 2 years ago
- An easy-to-follow Pytorch implementation of Hinton's Capsule Network☆190Updated last year
- Mish Deep Learning Activation Function for PyTorch / FastAI☆160Updated 4 years ago
- Implements the ideas presented in https://arxiv.org/pdf/2004.11362v1.pdf by Khosla et al.☆132Updated 4 years ago
- [ICLR'19] Trellis Networks for Sequence Modeling☆473Updated 5 years ago
- lookahead optimizer (Lookahead Optimizer: k steps forward, 1 step back) for pytorch☆334Updated 5 years ago
- Keras/TF implementation of AdamW, SGDW, NadamW, Warm Restarts, and Learning Rate multipliers☆167Updated 2 years ago
- Over9000 optimizer☆425Updated 2 years ago
- Implementing Stand-Alone Self-Attention in Vision Models using Pytorch☆455Updated 4 years ago
- Pytorch easy-to-follow Capsule Network tutorial☆768Updated 5 years ago
- Keras implementation of Sketch RNN☆145Updated 5 years ago
- Pytorch implementation of the paper "Class-Balanced Loss Based on Effective Number of Samples"☆785Updated 9 months ago
- Implements the unsupervised pre-training of convolutional neural networks☆249Updated 3 years ago
- PyTorch implementation of ICLR 2018 paper Learn To Pay Attention (and some modification)☆165Updated 4 years ago
- Class-Balanced Loss Based on Effective Number of Samples. CVPR 2019☆602Updated 3 years ago
- Pytorch implementation for NIPS2017 paper `Dynamic Routing Between Capsules`☆155Updated 6 years ago
- ☆144Updated 2 years ago
- Metrics for model evaluation in pytorch☆110Updated 3 years ago
- 🔥 Reproducibly benchmarking Keras and PyTorch models☆367Updated 3 years ago
- Unofficial PyTorch Implementation of Unsupervised Data Augmentation.☆147Updated 4 years ago
- lookahead optimizer for keras☆170Updated 5 years ago
- This is the pytorch implementation of the paper - Axiomatic Attribution for Deep Networks.☆181Updated 2 years ago
- pytorch implement of Lookahead Optimizer☆188Updated 2 years ago