zaidalyafeai / AttentioNNLinks
All about attention in neural networks. Soft attention, attention maps, local and global attention and multi-head attention.
☆231Updated 5 years ago
Alternatives and similar repositories for AttentioNN
Users that are interested in AttentioNN are comparing it to the libraries listed below
Sorting:
- Class-Balanced Loss Based on Effective Number of Samples. CVPR 2019☆612Updated 3 years ago
- A simpler version of the self-attention layer from SAGAN, and some image classification results.☆212Updated 5 years ago
- Experiments with supervised contrastive learning methods with different loss functions☆220Updated 2 years ago
- Source code for "On the Relationship between Self-Attention and Convolutional Layers"☆1,103Updated 2 years ago
- Semi-Supervised Learning with Ladder Networks in Keras. Get 98% test accuracy on MNIST with just 100 labeled examples !☆100Updated 4 years ago
- Official implementation of "Pseudo-Labeling and Confirmation Bias in Deep Semi-Supervised Learning"☆153Updated 4 years ago
- Unofficial PyTorch Implementation of Unsupervised Data Augmentation.☆147Updated 4 years ago
- Experiments with Adam/AdamW/amsgrad☆201Updated 6 years ago
- Pytorch easy-to-follow Capsule Network tutorial☆770Updated 5 years ago
- Implements the unsupervised pre-training of convolutional neural networks☆251Updated 3 years ago
- Keras/TF implementation of AdamW, SGDW, NadamW, Warm Restarts, and Learning Rate multipliers☆167Updated 3 years ago
- Keras implementation of Attention Augmented Convolutional Neural Networks☆121Updated 5 years ago
- [ICLR'19] Trellis Networks for Sequence Modeling☆472Updated 5 years ago
- ☆146Updated 3 years ago
- Implements the ideas presented in https://arxiv.org/pdf/2004.11362v1.pdf by Khosla et al.☆132Updated 5 years ago
- pytorch neural network attention mechanism☆147Updated 6 years ago
- Ensemble learning related books, papers, videos, and toolboxes☆295Updated 5 years ago
- Siamese Network implementation using Pytorch☆277Updated 2 years ago
- A curated list of resources about few-shot and one-shot learning☆282Updated 6 years ago
- A short tutorial on performing fine tuning or transfer learning in PyTorch.☆282Updated 6 years ago
- ☆351Updated 5 years ago
- Pytorch implementation of the paper "Class-Balanced Loss Based on Effective Number of Samples"☆798Updated last year
- A large scale study of Knowledge Distillation.☆220Updated 5 years ago
- Learning Confidence for Out-of-Distribution Detection in Neural Networks☆275Updated 7 years ago
- Public repo for Augmented Multiscale Deep InfoMax representation learning☆400Updated 4 years ago
- An unofficial implementation of MixMatch using fastai and Pytorch☆23Updated 5 years ago
- Implementation of the mixup training method☆466Updated 7 years ago
- Implementations for a family of attention mechanisms, suitable for all kinds of natural language processing tasks and compatible with Ten…☆360Updated last year
- lookahead optimizer (Lookahead Optimizer: k steps forward, 1 step back) for pytorch☆337Updated 5 years ago
- TensorFlow implementation of "Unsupervised Learning of Visual Features by Contrasting Cluster Assignments".☆86Updated 2 years ago