zaidalyafeai / AttentioNN
All about attention in neural networks. Soft attention, attention maps, local and global attention and multi-head attention.
☆231Updated 5 years ago
Alternatives and similar repositories for AttentioNN:
Users that are interested in AttentioNN are comparing it to the libraries listed below
- Implementations for a family of attention mechanisms, suitable for all kinds of natural language processing tasks and compatible with Ten…☆354Updated last year
- A simpler version of the self-attention layer from SAGAN, and some image classification results.☆213Updated 5 years ago
- Pytorch implementation of the paper "Class-Balanced Loss Based on Effective Number of Samples"☆792Updated last year
- Keras implementation of Attention Augmented Convolutional Neural Networks☆121Updated 5 years ago
- Ensemble learning related books, papers, videos, and toolboxes☆293Updated 5 years ago
- Class-Balanced Loss Based on Effective Number of Samples. CVPR 2019☆609Updated 3 years ago
- Source code for "On the Relationship between Self-Attention and Convolutional Layers"☆1,098Updated 2 years ago
- Experiments with supervised contrastive learning methods with different loss functions☆219Updated 2 years ago
- ☆145Updated 3 years ago
- A curated list of resources about few-shot and one-shot learning☆282Updated 5 years ago
- Multi-class classification with focal loss for imbalanced datasets☆82Updated 5 years ago
- Learning Confidence for Out-of-Distribution Detection in Neural Networks☆270Updated 6 years ago
- [NeurIPS 2020] Semi-Supervision (Unlabeled Data) & Self-Supervision Improve Class-Imbalanced / Long-Tailed Learning☆748Updated 3 years ago
- Implements the ideas presented in https://arxiv.org/pdf/2004.11362v1.pdf by Khosla et al.☆132Updated 4 years ago
- (Minimally) implements SimCLR (https://arxiv.org/abs/2002.05709) in TensorFlow 2.☆90Updated 3 years ago
- Unofficial PyTorch Implementation of Unsupervised Data Augmentation.☆146Updated 4 years ago
- [ICLR'19] Trellis Networks for Sequence Modeling☆472Updated 5 years ago
- Semi-Supervised Learning with Ladder Networks in Keras. Get 98% test accuracy on MNIST with just 100 labeled examples !☆101Updated 3 years ago
- A wrapper layer for stacking layers horizontally☆228Updated 3 years ago
- Repo to build on / reproduce the record breaking Ranger-Mish-SelfAttention setup on FastAI ImageWoof dataset 5 epochs☆116Updated 5 years ago
- Open source release of the evaluation benchmark suite described in "Realistic Evaluation of Deep Semi-Supervised Learning Algorithms"☆460Updated 5 years ago
- pytorch neural network attention mechanism☆147Updated 6 years ago
- Over9000 optimizer☆427Updated 2 years ago
- A novel method for few shot learning☆51Updated 5 years ago
- Keras/TF implementation of AdamW, SGDW, NadamW, Warm Restarts, and Learning Rate multipliers☆167Updated 3 years ago
- Visualization of GAN training process☆92Updated 4 years ago
- A machine learning experiment☆180Updated 7 years ago
- Code for reproducing Manifold Mixup results (ICML 2019)☆487Updated 11 months ago
- Mish Deep Learning Activation Function for PyTorch / FastAI☆161Updated 5 years ago
- Implementing Attention Augmented Convolutional Networks using Pytorch☆649Updated 3 years ago