[NeurIPS 2021 Spotlight] & [IJCV 2024] SOFT: Softmax-free Transformer with Linear Complexity
☆311Mar 16, 2024Updated 2 years ago
Alternatives and similar repositories for SOFT
Users that are interested in SOFT are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [NeurIPS 2021] [T-PAMI] DynamicViT: Efficient Vision Transformers with Dynamic Token Sparsification☆663Jul 11, 2023Updated 2 years ago
- Adaptive Split-Fusion Transformer (ICME 2023 Oral)☆19Feb 19, 2024Updated 2 years ago
- ☆249Mar 16, 2022Updated 4 years ago
- ICCV2021, Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNet☆1,196Oct 27, 2023Updated 2 years ago
- Preprocessing and baseline for N-Omniglot. Details can be found at https://www.nature.com/articles/s41597-022-01851-z..☆19Apr 12, 2023Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- PyTorch implementation of Towards Efficient Training for Neural Network Quantization☆16Jan 16, 2020Updated 6 years ago
- Python code for ICLR 2022 spotlight paper EViT: Expediting Vision Transformers via Token Reorganizations☆198Sep 3, 2023Updated 2 years ago
- PoolFormer: MetaFormer Is Actually What You Need for Vision (CVPR 2022 Oral)☆1,364Jun 1, 2024Updated 2 years ago
- [CVPR 2023] Official repository of Generative Semantic Segmentation☆222Sep 3, 2023Updated 2 years ago
- Lightweight Transformer for Multi-modal Tasks☆16Dec 9, 2022Updated 3 years ago
- r2live相关论文、代码中文注释以及代码改动☆11Sep 24, 2021Updated 4 years ago
- Official implementation of PVT series☆1,896Oct 27, 2022Updated 3 years ago
- Two simple and effective designs of vision transformer, which is on par with the Swin transformer☆610Feb 14, 2023Updated 3 years ago
- This is a collection of our NAS and Vision Transformer work.☆1,836Jul 25, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Official PyTorch Implementation of Long-Short Transformer (NeurIPS 2021).☆229Apr 18, 2022Updated 4 years ago
- DeiT implementation for Q-ViT☆26Apr 21, 2025Updated last year
- [NeurIPS 2021 Spotlight] Official code for "Focal Self-attention for Local-Global Interactions in Vision Transformers"☆556Mar 27, 2022Updated 4 years ago
- [CoRL 2022] SurroundDepth: Entangling Surrounding Views for Self-Supervised Multi-Camera Depth Estimation☆291Feb 9, 2023Updated 3 years ago
- Implementation of TC-Net for iSBIR: Triplet Classification Network for instance-level Sketch Based Image Retrieval.☆21Feb 23, 2020Updated 6 years ago
- [NeurIPS 2022] 4D Unsupervised Object Discovery☆55Dec 5, 2023Updated 2 years ago
- All Points Matter: Entropy-Regularized Distribution Alignment for Weakly-supervised 3D Segmentation (NeurIPS 2023)☆32Nov 3, 2023Updated 2 years ago
- Official implementation for "SimA: Simple Softmax-free Attention for Vision Transformers"☆47Apr 18, 2024Updated 2 years ago
- ☆98Apr 27, 2022Updated 4 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- [NeurIPS 2022 Spotlight] This is the official PyTorch implementation of "EcoFormer: Energy-Saving Attention with Linear Complexity"☆74Nov 15, 2022Updated 3 years ago
- An All-MLP solution for Vision, from Google AI☆1,060Jul 7, 2025Updated 11 months ago
- ☆76Sep 30, 2022Updated 3 years ago
- Pytorch library for fast transformer implementations☆1,771Mar 23, 2023Updated 3 years ago
- MSG-Transformer: Exchanging Local Spatial Information by Manipulating Messenger Tokens (CVPR 2022)☆80Oct 20, 2022Updated 3 years ago
- PyTorch implementation of LAMB for ImageNet/ResNet-50 training☆13May 13, 2021Updated 5 years ago
- ☆246Jul 23, 2021Updated 4 years ago
- ☆135Feb 10, 2023Updated 3 years ago
- This is an official implementation for "Contextual Transformer Networks for Visual Recognition".☆538Aug 8, 2021Updated 4 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Official code for paper "On the Connection between Local Attention and Dynamic Depth-wise Convolution" ICLR 2022 Spotlight☆185Nov 17, 2022Updated 3 years ago
- Official code for "Dynamic Token Normalization Improves Vision Transformer", ICLR 2022.☆30May 22, 2022Updated 4 years ago
- Source code for our AAAI'22 paper 《From Dense to Sparse: Contrastive Pruning for Better Pre-trained Language Model Compression》☆25Dec 15, 2021Updated 4 years ago
- Various test models in WNNX format. It can view with `pip install wnetron && wnetron`☆12Jun 22, 2022Updated 3 years ago
- This repository contains the code for the paper "TaylorShift: Shifting the Complexity of Self-Attention from Squared to Linear (and Back)…☆15Feb 25, 2026Updated 3 months ago
- ☆12Oct 11, 2024Updated last year
- Fixed version of https://github.com/tomguluson92/PRNet_PyTorch☆10Mar 30, 2020Updated 6 years ago