[NeurIPS 2021 Spotlight] & [IJCV 2024] SOFT: Softmax-free Transformer with Linear Complexity
☆311Mar 16, 2024Updated 2 years ago
Alternatives and similar repositories for SOFT
Users that are interested in SOFT are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The code of 《HAM: Hidden Anchor Mechanism for Scene Text Detection》☆11Sep 22, 2020Updated 5 years ago
- [NeurIPS 2021] [T-PAMI] DynamicViT: Efficient Vision Transformers with Dynamic Token Sparsification☆660Jul 11, 2023Updated 2 years ago
- Adaptive Split-Fusion Transformer (ICME 2023 Oral)☆19Feb 19, 2024Updated 2 years ago
- ☆249Mar 16, 2022Updated 4 years ago
- ICCV2021, Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNet☆1,195Oct 27, 2023Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- PyTorch implementation of Towards Efficient Training for Neural Network Quantization☆16Jan 16, 2020Updated 6 years ago
- Python code for ICLR 2022 spotlight paper EViT: Expediting Vision Transformers via Token Reorganizations☆198Sep 3, 2023Updated 2 years ago
- PoolFormer: MetaFormer Is Actually What You Need for Vision (CVPR 2022 Oral)☆1,364Jun 1, 2024Updated last year
- [CVPR 2023] Official repository of Generative Semantic Segmentation☆222Sep 3, 2023Updated 2 years ago
- Lightweight Transformer for Multi-modal Tasks☆16Dec 9, 2022Updated 3 years ago
- Official implementation of PVT series☆1,893Oct 27, 2022Updated 3 years ago
- Two simple and effective designs of vision transformer, which is on par with the Swin transformer☆609Feb 14, 2023Updated 3 years ago
- This is a collection of our NAS and Vision Transformer work.☆1,835Jul 25, 2024Updated last year
- Official PyTorch Implementation of Long-Short Transformer (NeurIPS 2021).☆229Apr 18, 2022Updated 4 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- DeiT implementation for Q-ViT☆26Apr 21, 2025Updated last year
- [NeurIPS 2021 Spotlight] Official code for "Focal Self-attention for Local-Global Interactions in Vision Transformers"☆556Mar 27, 2022Updated 4 years ago
- [CoRL 2022] SurroundDepth: Entangling Surrounding Views for Self-Supervised Multi-Camera Depth Estimation☆290Feb 9, 2023Updated 3 years ago
- Implementation of TC-Net for iSBIR: Triplet Classification Network for instance-level Sketch Based Image Retrieval.☆21Feb 23, 2020Updated 6 years ago
- [NeurIPS 2022] 4D Unsupervised Object Discovery☆55Dec 5, 2023Updated 2 years ago
- PyTorch implementation of DGECN☆14Jun 28, 2022Updated 3 years ago
- All Points Matter: Entropy-Regularized Distribution Alignment for Weakly-supervised 3D Segmentation (NeurIPS 2023)☆32Nov 3, 2023Updated 2 years ago
- Official implementation for "SimA: Simple Softmax-free Attention for Vision Transformers"☆47Apr 18, 2024Updated 2 years ago
- ☆98Apr 27, 2022Updated 4 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- [NeurIPS 2022 Spotlight] This is the official PyTorch implementation of "EcoFormer: Energy-Saving Attention with Linear Complexity"☆74Nov 15, 2022Updated 3 years ago
- An All-MLP solution for Vision, from Google AI☆1,059Jul 7, 2025Updated 10 months ago
- ☆76Sep 30, 2022Updated 3 years ago
- Pytorch library for fast transformer implementations☆1,771Mar 23, 2023Updated 3 years ago
- MSG-Transformer: Exchanging Local Spatial Information by Manipulating Messenger Tokens (CVPR 2022)☆80Oct 20, 2022Updated 3 years ago
- ☆246Jul 23, 2021Updated 4 years ago
- ☆135Feb 10, 2023Updated 3 years ago
- This is an official implementation for "Contextual Transformer Networks for Visual Recognition".☆538Aug 8, 2021Updated 4 years ago
- Official code for paper "On the Connection between Local Attention and Dynamic Depth-wise Convolution" ICLR 2022 Spotlight☆184Nov 17, 2022Updated 3 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Official code for "Dynamic Token Normalization Improves Vision Transformer", ICLR 2022.☆30May 22, 2022Updated 3 years ago
- Source code for our AAAI'22 paper 《From Dense to Sparse: Contrastive Pruning for Better Pre-trained Language Model Compression》☆25Dec 15, 2021Updated 4 years ago
- Various test models in WNNX format. It can view with `pip install wnetron && wnetron`☆12Jun 22, 2022Updated 3 years ago
- This repository contains the code for the paper "TaylorShift: Shifting the Complexity of Self-Attention from Squared to Linear (and Back)…☆14Feb 25, 2026Updated 2 months ago
- ☆12Oct 11, 2024Updated last year
- Fixed version of https://github.com/tomguluson92/PRNet_PyTorch☆10Mar 30, 2020Updated 6 years ago
- Official DeiT repository☆4,342Mar 15, 2024Updated 2 years ago