xl402 / performer
Tensorflow implementation of a linear attention architecture
☆44Updated 3 years ago
Related projects ⓘ
Alternatives and complementary repositories for performer
- Simple stochastic weight averaging callback for Keras☆63Updated 3 years ago
- Implements MLP-Mixer (https://arxiv.org/abs/2105.01601) with the CIFAR-10 dataset.☆54Updated 2 years ago
- Implementation of Feedback Transformer in Pytorch☆104Updated 3 years ago
- Implementation of ETSformer, state of the art time-series Transformer, in Pytorch☆149Updated last year
- Implementation of H-Transformer-1D, Hierarchical Attention for Sequence Learning☆155Updated 9 months ago
- Unofficial PyTorch implementation of Fastformer based on paper "Fastformer: Additive Attention Can Be All You Need"."☆134Updated 3 years ago
- Implementation of self-supervised image-level contrastive pretraining methods using Keras.☆69Updated 3 years ago
- State of the art faster Transformer with Tensorflow 2.0 ( NLP, Computer Vision, Audio ).☆85Updated last year
- Fourth place solution to the "OpenVaccine: COVID-19 mRNA Vaccine Degradation Prediction" organized by Stanford University and Kaggle☆20Updated 4 years ago
- Implements sharpness-aware minimization (https://arxiv.org/abs/2010.01412) in TensorFlow 2.☆61Updated 3 years ago
- Efficient Transformers for research, PyTorch and Tensorflow using Locality Sensitive Hashing☆93Updated 4 years ago
- HMMs in PyTorch☆135Updated 3 years ago
- Cyclemoid implementation for PyTorch☆87Updated 2 years ago
- Code for scaling Transformers☆26Updated 3 years ago
- Implementation of the GBST block from the Charformer paper, in Pytorch☆117Updated 3 years ago
- Simply Numpy implementation of the FAVOR+ attention mechanism, https://teddykoker.com/2020/11/performers/☆37Updated 3 years ago
- ☆60Updated 11 months ago
- Python implementation of GLN in different frameworks☆95Updated 4 years ago
- ☆18Updated 2 years ago
- Implementation of modern data augmentation techniques in TensorFlow 2.x to be used in your training pipeline.☆35Updated 4 years ago
- A repository containing the code for the Bistable Recurrent Cell☆47Updated 3 years ago
- Layerwise Batch Entropy Regularization☆22Updated 2 years ago
- Personal AI Implementations☆16Updated 4 years ago
- Implementation of Nyström Self-attention, from the paper Nyströmformer☆122Updated 10 months ago
- ☆164Updated last year
- Sequence Modeling with Structured State Spaces☆60Updated 2 years ago
- Tensorflow Keras implementation of ordinal regression using consistent rank logits (CORAL) by Cao et al. (2019)☆79Updated 2 years ago
- Minimal implementation of SimSiam (https://arxiv.org/abs/2011.10566) in TensorFlow 2.☆97Updated 3 years ago
- Implementation of Fast Transformer in Pytorch☆171Updated 3 years ago
- ☆24Updated last year