zaidalyafeai / AttentioNN
All about attention in neural networks. Soft attention, attention maps, local and global attention and multi-head attention.
☆226Updated 4 years ago
Related projects: ⓘ
- Experiments with supervised contrastive learning methods with different loss functions☆211Updated last year
- A simpler version of the self-attention layer from SAGAN, and some image classification results.☆210Updated 5 years ago
- [ICLR'19] Trellis Networks for Sequence Modeling☆473Updated 5 years ago
- Implementations for a family of attention mechanisms, suitable for all kinds of natural language processing tasks and compatible with Ten…☆341Updated 7 months ago
- A curated list of resources about few-shot and one-shot learning☆281Updated 5 years ago
- Keras implementation of Attention Augmented Convolutional Neural Networks☆120Updated 4 years ago
- Pytorch implementation for NIPS2017 paper `Dynamic Routing Between Capsules`☆154Updated 6 years ago
- Keras/TF implementation of AdamW, SGDW, NadamW, Warm Restarts, and Learning Rate multipliers☆166Updated 2 years ago
- Class-Balanced Loss Based on Effective Number of Samples. CVPR 2019☆599Updated 3 years ago
- Pytorch implementation of the paper "Class-Balanced Loss Based on Effective Number of Samples"☆781Updated 7 months ago
- A novel method for few shot learning☆50Updated 4 years ago
- lookahead optimizer (Lookahead Optimizer: k steps forward, 1 step back) for pytorch☆333Updated 5 years ago
- An easy-to-follow Pytorch implementation of Hinton's Capsule Network☆189Updated last year
- Learning Confidence for Out-of-Distribution Detection in Neural Networks☆265Updated 6 years ago
- Implements the ideas presented in https://arxiv.org/pdf/2004.11362v1.pdf by Khosla et al.☆129Updated 4 years ago
- Semi-Supervised Learning with Ladder Networks in Keras. Get 98% test accuracy on MNIST with just 100 labeled examples !☆101Updated 3 years ago
- Multi heads attention for image classification☆80Updated 6 years ago
- A short tutorial on performing fine tuning or transfer learning in PyTorch.☆278Updated 6 years ago
- Implementation of the mixup training method☆460Updated 6 years ago
- Various implementations of Generative adversarial networks using Pytorch☆178Updated 4 years ago
- pytorch implement of Lookahead Optimizer☆188Updated 2 years ago
- An unofficial implementation of MixMatch using fastai and Pytorch☆24Updated 4 years ago
- Experiments with Adam/AdamW/amsgrad☆194Updated 6 years ago
- Unofficial PyTorch Implementation of Unsupervised Data Augmentation.☆147Updated 3 years ago
- Multi-class classification with focal loss for imbalanced datasets☆82Updated 4 years ago
- Ensemble learning related books, papers, videos, and toolboxes☆286Updated 4 years ago
- Mish Deep Learning Activation Function for PyTorch / FastAI☆160Updated 4 years ago
- Code for MentorNet: Learning Data-Driven Curriculum for Very Deep Neural Networks☆320Updated last year
- Virtual Adversarial Training (VAT) implementation for PyTorch☆296Updated 5 years ago
- Pytorch implementation of R-Transformer. Some parts of the code are adapted from the implementation of TCN and Transformer.☆224Updated 5 years ago