zaidalyafeai / AttentioNNLinks
All about attention in neural networks. Soft attention, attention maps, local and global attention and multi-head attention.
☆234Updated 5 years ago
Alternatives and similar repositories for AttentioNN
Users that are interested in AttentioNN are comparing it to the libraries listed below
Sorting:
- Keras implementation of Attention Augmented Convolutional Neural Networks☆121Updated 5 years ago
- A simpler version of the self-attention layer from SAGAN, and some image classification results.☆214Updated 6 years ago
- Implements the ideas presented in https://arxiv.org/pdf/2004.11362v1.pdf by Khosla et al.☆133Updated 5 years ago
- Multi heads attention for image classification☆80Updated 7 years ago
- Keras/TF implementation of AdamW, SGDW, NadamW, Warm Restarts, and Learning Rate multipliers☆169Updated 3 years ago
- Semi-Supervised Learning with Ladder Networks in Keras. Get 98% test accuracy on MNIST with just 100 labeled examples !☆101Updated 4 years ago
- Multi-class classification with focal loss for imbalanced datasets☆82Updated 6 years ago
- A novel method for few shot learning☆53Updated 6 years ago
- Implementation of Rectified Adam in Keras☆70Updated 6 years ago
- TensorFlow implementation of "Unsupervised Learning of Visual Features by Contrasting Cluster Assignments".☆87Updated 3 years ago
- Pytorch notebook with One Cycle Policy implementation (https://arxiv.org/abs/1803.09820)☆73Updated 3 years ago
- Various implementations of Generative adversarial networks using Pytorch☆181Updated 6 years ago
- ☆16Updated 7 years ago
- Implementations for a family of attention mechanisms, suitable for all kinds of natural language processing tasks and compatible with Ten…☆362Updated last year
- Repo to build on / reproduce the record breaking Ranger-Mish-SelfAttention setup on FastAI ImageWoof dataset 5 epochs☆116Updated 6 years ago
- Tensorflow-Keras implementation of SimCLR: Simple Framework for Contrastive Learning of Visual Representations by Chen et al. (2020)☆111Updated 11 months ago
- An easy-to-follow Pytorch implementation of Hinton's Capsule Network☆203Updated 3 years ago
- Simple Tensorflow implementation of "On The Variance Of The Adaptive Learning Rate And Beyond"☆97Updated 5 years ago
- AdamW optimizer for Keras☆115Updated 6 years ago
- Experiments with supervised contrastive learning methods with different loss functions☆223Updated 3 years ago
- Robust Bi-Tempered Logistic Loss Based on Bregman Divergences. https://arxiv.org/pdf/1906.03361.pdf☆147Updated 3 years ago
- Pytorch implementation for NIPS2017 paper `Dynamic Routing Between Capsules`☆159Updated 8 years ago
- ☆148Updated 3 years ago
- Some State-of-the-Art few shot learning algorithms in tensorflow 2☆213Updated 2 years ago
- Meta learning framework with Tensorflow 2.0☆117Updated 2 years ago
- (Minimally) implements SimCLR (https://arxiv.org/abs/2002.05709) in TensorFlow 2.☆90Updated 4 years ago
- Mish Deep Learning Activation Function for PyTorch / FastAI☆161Updated 5 years ago
- Keras implementation of Balancing GAN (BAGAN) applied to the MNIST example.☆111Updated 4 years ago
- ☆86Updated 2 years ago
- This repository contain various types of attention mechanism like Bahdanau , Soft attention , Additive Attention , Hierarchical Attention…☆127Updated 4 years ago