zaidalyafeai / AttentioNNLinks
All about attention in neural networks. Soft attention, attention maps, local and global attention and multi-head attention.
☆233Updated 5 years ago
Alternatives and similar repositories for AttentioNN
Users that are interested in AttentioNN are comparing it to the libraries listed below
Sorting:
- A simpler version of the self-attention layer from SAGAN, and some image classification results.☆214Updated 6 years ago
- Keras implementation of Attention Augmented Convolutional Neural Networks☆121Updated 5 years ago
- Multi-class classification with focal loss for imbalanced datasets☆82Updated 6 years ago
- Multi heads attention for image classification☆79Updated 7 years ago
- Implements the ideas presented in https://arxiv.org/pdf/2004.11362v1.pdf by Khosla et al.☆133Updated 5 years ago
- Keras/TF implementation of AdamW, SGDW, NadamW, Warm Restarts, and Learning Rate multipliers☆168Updated 3 years ago
- ☆16Updated 7 years ago
- A novel method for few shot learning☆52Updated 5 years ago
- Implementations for a family of attention mechanisms, suitable for all kinds of natural language processing tasks and compatible with Ten…☆362Updated last year
- Various implementations of Generative adversarial networks using Pytorch☆181Updated 5 years ago
- Semi-Supervised Learning with Ladder Networks in Keras. Get 98% test accuracy on MNIST with just 100 labeled examples !☆100Updated 4 years ago
- Some State-of-the-Art few shot learning algorithms in tensorflow 2☆215Updated last year
- Experiments with supervised contrastive learning methods with different loss functions☆221Updated 2 years ago
- Pytorch implementation for NIPS2017 paper `Dynamic Routing Between Capsules`☆159Updated 7 years ago
- Meta learning framework with Tensorflow 2.0☆118Updated 2 years ago
- TensorFlow implementation of "Unsupervised Learning of Visual Features by Contrasting Cluster Assignments".☆86Updated 3 years ago
- Implementation of Rectified Adam in Keras☆70Updated 6 years ago
- Pytorch notebook with One Cycle Policy implementation (https://arxiv.org/abs/1803.09820)☆73Updated 3 years ago
- Repo to build on / reproduce the record breaking Ranger-Mish-SelfAttention setup on FastAI ImageWoof dataset 5 epochs☆116Updated 5 years ago
- Official Pytorch code for (AAAI 2020) paper "Capsule Routing via Variational Bayes", https://arxiv.org/pdf/1905.11455.pdf☆103Updated 4 years ago
- This repository contain various types of attention mechanism like Bahdanau , Soft attention , Additive Attention , Hierarchical Attention…☆125Updated 4 years ago
- An easy-to-follow Pytorch implementation of Hinton's Capsule Network☆200Updated 2 years ago
- Mish Deep Learning Activation Function for PyTorch / FastAI☆161Updated 5 years ago
- ☆86Updated 2 years ago
- ☆148Updated 3 years ago
- pytorch neural network attention mechanism☆147Updated 6 years ago
- Pytorch Tutorial, Pytorch with Google Colab, Pytorch Implementations: CNN, RNN, DCGAN, Transfer Learning, Chatbot, Pytorch Sample Codes☆432Updated 6 years ago
- Robust Bi-Tempered Logistic Loss Based on Bregman Divergences. https://arxiv.org/pdf/1906.03361.pdf☆147Updated 3 years ago
- Implementation of Zero-Shot Learning algorithm using Word2Vecs as class embeddings☆86Updated 6 years ago
- Experiments on different dataset on how to grow networks during training to learn new image categories.☆62Updated 5 years ago