zaidalyafeai / AttentioNNLinks
All about attention in neural networks. Soft attention, attention maps, local and global attention and multi-head attention.
☆231Updated 5 years ago
Alternatives and similar repositories for AttentioNN
Users that are interested in AttentioNN are comparing it to the libraries listed below
Sorting:
- Keras implementation of Attention Augmented Convolutional Neural Networks☆121Updated 5 years ago
- A simpler version of the self-attention layer from SAGAN, and some image classification results.☆212Updated 5 years ago
- Implements the ideas presented in https://arxiv.org/pdf/2004.11362v1.pdf by Khosla et al.☆132Updated 5 years ago
- Keras/TF implementation of AdamW, SGDW, NadamW, Warm Restarts, and Learning Rate multipliers☆169Updated 3 years ago
- Multi heads attention for image classification☆80Updated 7 years ago
- Pytorch notebook with One Cycle Policy implementation (https://arxiv.org/abs/1803.09820)☆73Updated 3 years ago
- Various implementations of Generative adversarial networks using Pytorch☆180Updated 5 years ago
- Multi-class classification with focal loss for imbalanced datasets☆82Updated 5 years ago
- Repo to build on / reproduce the record breaking Ranger-Mish-SelfAttention setup on FastAI ImageWoof dataset 5 epochs☆116Updated 5 years ago
- Semi-Supervised Learning with Ladder Networks in Keras. Get 98% test accuracy on MNIST with just 100 labeled examples !☆100Updated 4 years ago
- This repository is for coding exercises listed in Book Hands on One Shot Learning.☆112Updated 2 years ago
- An easy-to-follow Pytorch implementation of Hinton's Capsule Network☆200Updated 2 years ago
- Experiments on different dataset on how to grow networks during training to learn new image categories.☆62Updated 5 years ago
- Meta learning framework with Tensorflow 2.0☆118Updated 2 years ago
- TensorFlow implementation of "Unsupervised Learning of Visual Features by Contrasting Cluster Assignments".☆86Updated 3 years ago
- Mish Deep Learning Activation Function for PyTorch / FastAI☆161Updated 5 years ago
- Some State-of-the-Art few shot learning algorithms in tensorflow 2☆215Updated last year
- A novel method for few shot learning☆52Updated 5 years ago
- A pytorch dataset sampler for always sampling balanced batches.☆116Updated 4 years ago
- Implementation of Rectified Adam in Keras☆70Updated 6 years ago
- Experiments with supervised contrastive learning methods with different loss functions☆220Updated 2 years ago
- Creates a learning-curve plot for Jupyter/Colab notebooks that is updated in real-time.☆177Updated 3 years ago
- Robust Bi-Tempered Logistic Loss Based on Bregman Divergences. https://arxiv.org/pdf/1906.03361.pdf☆147Updated 3 years ago
- pytorch implement of Lookahead Optimizer☆194Updated 3 years ago
- A curated list of resources about few-shot and one-shot learning☆283Updated 6 years ago
- Official Pytorch code for (AAAI 2020) paper "Capsule Routing via Variational Bayes", https://arxiv.org/pdf/1905.11455.pdf☆103Updated 4 years ago
- Implementation of autoencoders in PyTorch☆57Updated 7 years ago
- Implementations for a family of attention mechanisms, suitable for all kinds of natural language processing tasks and compatible with Ten…☆362Updated last year
- Experiments with Adam/AdamW/amsgrad☆201Updated 6 years ago
- Tensorflow-Keras implementation of SimCLR: Simple Framework for Contrastive Learning of Visual Representations by Chen et al. (2020)☆110Updated 8 months ago