zaidalyafeai / AttentioNN
All about attention in neural networks. Soft attention, attention maps, local and global attention and multi-head attention.
☆231Updated 5 years ago
Alternatives and similar repositories for AttentioNN:
Users that are interested in AttentioNN are comparing it to the libraries listed below
- Keras implementation of Attention Augmented Convolutional Neural Networks☆121Updated 5 years ago
- A simpler version of the self-attention layer from SAGAN, and some image classification results.☆213Updated 5 years ago
- Implementations for a family of attention mechanisms, suitable for all kinds of natural language processing tasks and compatible with Ten…☆354Updated last year
- Multi heads attention for image classification☆81Updated 6 years ago
- Experiments with supervised contrastive learning methods with different loss functions☆218Updated 2 years ago
- Implements the ideas presented in https://arxiv.org/pdf/2004.11362v1.pdf by Khosla et al.☆132Updated 4 years ago
- High-level batteries-included neural network training library for Pytorch☆398Updated 3 years ago
- Implementing Attention Augmented Convolutional Networks using Pytorch☆649Updated 3 years ago
- Over9000 optimizer☆427Updated 2 years ago
- ☆144Updated 3 years ago
- A short tutorial on performing fine tuning or transfer learning in PyTorch.☆281Updated 6 years ago
- [ICLR'19] Trellis Networks for Sequence Modeling☆471Updated 5 years ago
- pytorch implement of Lookahead Optimizer☆189Updated 2 years ago
- Source code for "On the Relationship between Self-Attention and Convolutional Layers"☆1,098Updated 2 years ago
- Repo to build on / reproduce the record breaking Ranger-Mish-SelfAttention setup on FastAI ImageWoof dataset 5 epochs☆116Updated 5 years ago
- lookahead optimizer (Lookahead Optimizer: k steps forward, 1 step back) for pytorch☆334Updated 5 years ago
- Keras callback function for stochastic weight averaging☆56Updated 2 years ago
- Keras implementation of Representation Learning with Contrastive Predictive Coding☆535Updated 5 years ago
- Pytorch implementation of the paper "Class-Balanced Loss Based on Effective Number of Samples"☆792Updated last year
- Mish Deep Learning Activation Function for PyTorch / FastAI☆161Updated 4 years ago
- A curated list of resources about few-shot and one-shot learning☆282Updated 5 years ago
- A New Optimization Technique for Deep Neural Networks☆535Updated 3 years ago
- This repository contain various types of attention mechanism like Bahdanau , Soft attention , Additive Attention , Hierarchical Attention…☆125Updated 3 years ago
- Multi-Task Learning Framework on PyTorch. State-of-the-art methods are implemented to effectively train models on multiple tasks.☆149Updated 5 years ago
- Public repo for Augmented Multiscale Deep InfoMax representation learning☆401Updated 4 years ago
- This in my Demo of Chen et al. "GradNorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networks" ICML 2018☆172Updated 3 years ago
- A Pytorch-Lightning implementation of self-supervised algorithms☆537Updated 2 years ago
- Implementation of papers on Deep Seq2seq learning using Pytorch.☆219Updated 6 years ago
- Pytorch implementation for NIPS2017 paper `Dynamic Routing Between Capsules`☆156Updated 7 years ago
- An unofficial implementation of MixMatch using fastai and Pytorch☆23Updated 5 years ago