zaidalyafeai / AttentioNNLinks
All about attention in neural networks. Soft attention, attention maps, local and global attention and multi-head attention.
☆231Updated 5 years ago
Alternatives and similar repositories for AttentioNN
Users that are interested in AttentioNN are comparing it to the libraries listed below
Sorting:
- A simpler version of the self-attention layer from SAGAN, and some image classification results.☆212Updated 5 years ago
- Source code for "On the Relationship between Self-Attention and Convolutional Layers"☆1,102Updated 2 years ago
- Experiments with supervised contrastive learning methods with different loss functions☆220Updated 2 years ago
- A curated list of resources about few-shot and one-shot learning☆282Updated 6 years ago
- [ICLR'19] Trellis Networks for Sequence Modeling☆472Updated 5 years ago
- Mish Deep Learning Activation Function for PyTorch / FastAI☆161Updated 5 years ago
- Implementing Attention Augmented Convolutional Networks using Pytorch☆653Updated 3 years ago
- Implements the ideas presented in https://arxiv.org/pdf/2004.11362v1.pdf by Khosla et al.☆132Updated 4 years ago
- Keras implementation of Attention Augmented Convolutional Neural Networks☆121Updated 5 years ago
- Implementations for a family of attention mechanisms, suitable for all kinds of natural language processing tasks and compatible with Ten…☆359Updated last year
- Pytorch implementation for NIPS2017 paper `Dynamic Routing Between Capsules`☆157Updated 7 years ago
- 🔥 Reproducibly benchmarking Keras and PyTorch models☆367Updated 4 years ago
- Multi heads attention for image classification☆80Updated 7 years ago
- Keras callback function for stochastic weight averaging☆56Updated 2 years ago
- lookahead optimizer (Lookahead Optimizer: k steps forward, 1 step back) for pytorch☆336Updated 5 years ago
- High-level batteries-included neural network training library for Pytorch☆402Updated 3 years ago
- Class-Balanced Loss Based on Effective Number of Samples. CVPR 2019☆611Updated 3 years ago
- A wrapper layer for stacking layers horizontally☆228Updated 3 years ago
- PyTorch implementation of ICLR 2018 paper Learn To Pay Attention (and some modification)☆167Updated 4 years ago
- Ensemble learning related books, papers, videos, and toolboxes☆294Updated 5 years ago
- Over9000 optimizer☆426Updated 2 years ago
- Repo to build on / reproduce the record breaking Ranger-Mish-SelfAttention setup on FastAI ImageWoof dataset 5 epochs☆116Updated 5 years ago
- Multi-class classification with focal loss for imbalanced datasets☆82Updated 5 years ago
- This repository is for coding exercises listed in Book Hands on One Shot Learning.☆110Updated 2 years ago
- Keras implementation of Representation Learning with Contrastive Predictive Coding☆540Updated 5 years ago
- Pytorch implementation of the paper "Class-Balanced Loss Based on Effective Number of Samples"☆798Updated last year
- Pytorch notebook with One Cycle Policy implementation (https://arxiv.org/abs/1803.09820)☆74Updated 2 years ago
- PyTorch Implementation of Focal Loss and Lovasz-Softmax Loss☆334Updated 3 years ago
- A pytorch dataset sampler for always sampling balanced batches.☆115Updated 4 years ago
- Scaling and Benchmarking Self-Supervised Visual Representation Learning☆586Updated 3 years ago