zaidalyafeai / AttentioNN
All about attention in neural networks. Soft attention, attention maps, local and global attention and multi-head attention.
☆231Updated 5 years ago
Alternatives and similar repositories for AttentioNN:
Users that are interested in AttentioNN are comparing it to the libraries listed below
- A simpler version of the self-attention layer from SAGAN, and some image classification results.☆212Updated 5 years ago
- Source code for "On the Relationship between Self-Attention and Convolutional Layers"☆1,100Updated 2 years ago
- [ICLR'19] Trellis Networks for Sequence Modeling☆472Updated 5 years ago
- Keras implementation of Attention Augmented Convolutional Neural Networks☆121Updated 5 years ago
- Implementations for a family of attention mechanisms, suitable for all kinds of natural language processing tasks and compatible with Ten…☆357Updated last year
- Experiments with supervised contrastive learning methods with different loss functions☆220Updated 2 years ago
- lookahead optimizer (Lookahead Optimizer: k steps forward, 1 step back) for pytorch☆335Updated 5 years ago
- Pytorch implementation for NIPS2017 paper `Dynamic Routing Between Capsules`☆157Updated 7 years ago
- ☆146Updated 3 years ago
- Class-Balanced Loss Based on Effective Number of Samples. CVPR 2019☆609Updated 3 years ago
- Multi heads attention for image classification☆81Updated 7 years ago
- An easy-to-follow Pytorch implementation of Hinton's Capsule Network☆197Updated 2 years ago
- Mish Deep Learning Activation Function for PyTorch / FastAI☆161Updated 5 years ago
- Pytorch implementation of the paper "Class-Balanced Loss Based on Effective Number of Samples"☆796Updated last year
- Pytorch easy-to-follow Capsule Network tutorial☆769Updated 5 years ago
- This repository contain various types of attention mechanism like Bahdanau , Soft attention , Additive Attention , Hierarchical Attention…☆125Updated 3 years ago
- A pytorch dataset sampler for always sampling balanced batches.☆114Updated 4 years ago
- Unofficial PyTorch Implementation of Unsupervised Data Augmentation.☆146Updated 4 years ago
- Multi-class classification with focal loss for imbalanced datasets☆82Updated 5 years ago
- lookahead optimizer for keras☆170Updated 5 years ago
- Official Implementation of "DeepCaps: Going Deeper with Capsule Networks" paper (CVPR 2019).☆150Updated 4 years ago
- Ensemble learning related books, papers, videos, and toolboxes☆293Updated 5 years ago
- Keras/TF implementation of AdamW, SGDW, NadamW, Warm Restarts, and Learning Rate multipliers☆167Updated 3 years ago
- pytorch implement of Lookahead Optimizer☆189Updated 2 years ago
- ☆86Updated 2 years ago
- An implementation of "mixup: Beyond Empirical Risk Minimization"☆285Updated 7 years ago
- Keras callback function for stochastic weight averaging☆56Updated 2 years ago
- A short tutorial on performing fine tuning or transfer learning in PyTorch.☆282Updated 6 years ago
- ☆124Updated 2 years ago
- Virtual Adversarial Training (VAT) implementation for PyTorch☆296Updated 6 years ago