haofanwang / awesome-mlp-papers
Recent Advances in MLP-based Models (MLP is all you need!)
☆112Updated last year
Related projects ⓘ
Alternatives and complementary repositories for awesome-mlp-papers
- Implementation of ASAM: Adaptive Sharpness-Aware Minimization for Scale-Invariant Learning of Deep Neural Networks, ICML 2021.☆140Updated 3 years ago
- Unofficial implementation of MLP-Mixer: An all-MLP Architecture for Vision☆209Updated 3 years ago
- ☆189Updated last year
- NeurIPS 2021, Official codes for "Efficient Training of Visual Transformers with Small Datasets".☆139Updated last year
- Code repository of the paper "Modelling Long Range Dependencies in ND: From Task-Specific to a General Purpose CNN" https://arxiv.org/abs…☆181Updated last year
- MLP-Like Vision Permutator for Visual Recognition (PyTorch)☆190Updated 2 years ago
- Implementation of ResMLP, an all MLP solution to image classification, in Pytorch☆196Updated last year
- Code for paper "Orthogonal Convolutional Neural Networks".☆113Updated 3 years ago
- AdaShare: Learning What To Share For Efficient Deep Multi-Task Learning☆111Updated 3 years ago
- Unofficial Implementation of MLP-Mixer, gMLP, resMLP, Vision Permutator, S2MLP, S2MLPv2, RaftMLP, HireMLP, ConvMLP, AS-MLP, SparseMLP, Co…☆166Updated 2 years ago
- [ICLR 2022] "Anti-Oversmoothing in Deep Vision Transformers via the Fourier Domain Analysis: From Theory to Practice" by Peihao Wang, Wen…☆75Updated 10 months ago
- Whitening for Self-Supervised Representation Learning | Official repository☆125Updated last year
- Transformers w/o Attention, based fully on MLPs☆89Updated 7 months ago
- [NeurIPS 2022 Spotlight] This is the official PyTorch implementation of "EcoFormer: Energy-Saving Attention with Linear Complexity"☆66Updated 2 years ago
- This repo is for our paper: Normalization Techniques in Training DNNs: Methodology, Analysis and Application☆84Updated 3 years ago
- Reproducing the Linear Multihead Attention introduced in Linformer paper (Linformer: Self-Attention with Linear Complexity)☆73Updated 4 years ago
- Implementation of Visual Transformer for Small-size Datasets☆117Updated 2 years ago
- open source the research work for published on arxiv. https://arxiv.org/abs/2106.02689☆51Updated 2 years ago
- [ICLR'22 Oral] Implementation of "CycleMLP: A MLP-like Architecture for Dense Prediction"☆281Updated 2 years ago
- Un-Mix: Rethinking Image Mixtures for Unsupervised Visual Representation Learning.☆149Updated 2 years ago
- custom pytorch implementation of MoCo v3☆44Updated 3 years ago
- PyTorch implementation of EMAN for self-supervised and semi-supervised learning: https://arxiv.org/abs/2101.08482☆101Updated 3 years ago
- [ICLR 2022] Official implementation of cosformer-attention in cosFormer: Rethinking Softmax in Attention☆179Updated last year
- TF/Keras code for DiffStride, a pooling layer with learnable strides.☆124Updated 2 years ago
- [NeurIPS 2021]: Are Transformers More Robust Than CNNs? (Pytorch implementation & checkpoints)☆176Updated 2 years ago
- Implementation of Uniformer, a simple attention and 3d convolutional net that achieved SOTA in a number of video classification tasks, de…☆97Updated 2 years ago
- ResMLP: Feedforward networks for image classification with data-efficient training☆39Updated 3 years ago
- Implementation of Transformer in Transformer, pixel level attention paired with patch level attention for image classification, in Pytorc…☆300Updated 2 years ago
- ☆195Updated 3 months ago
- code for NASViT☆66Updated 2 years ago