[NeurIPS 2021 Spotlight] & [IJCV 2024] SOFT: Softmax-free Transformer with Linear Complexity
☆311Mar 16, 2024Updated 2 years ago
Alternatives and similar repositories for SOFT
Users that are interested in SOFT are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The code of 《HAM: Hidden Anchor Mechanism for Scene Text Detection》☆11Sep 22, 2020Updated 5 years ago
- [NeurIPS 2021] [T-PAMI] DynamicViT: Efficient Vision Transformers with Dynamic Token Sparsification☆657Jul 11, 2023Updated 2 years ago
- Adaptive Split-Fusion Transformer (ICME 2023 Oral)☆19Feb 19, 2024Updated 2 years ago
- ☆249Mar 16, 2022Updated 4 years ago
- ICCV2021, Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNet☆1,195Oct 27, 2023Updated 2 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- PyTorch implementation of Towards Efficient Training for Neural Network Quantization☆16Jan 16, 2020Updated 6 years ago
- Python code for ICLR 2022 spotlight paper EViT: Expediting Vision Transformers via Token Reorganizations☆198Sep 3, 2023Updated 2 years ago
- PoolFormer: MetaFormer Is Actually What You Need for Vision (CVPR 2022 Oral)☆1,363Jun 1, 2024Updated last year
- [CVPR 2023] Official repository of Generative Semantic Segmentation☆222Sep 3, 2023Updated 2 years ago
- Lightweight Transformer for Multi-modal Tasks☆16Dec 9, 2022Updated 3 years ago
- r2live相关论文、代码中文注释以及代码改动☆11Sep 24, 2021Updated 4 years ago
- Official implementation of PVT series☆1,891Oct 27, 2022Updated 3 years ago
- Two simple and effective designs of vision transformer, which is on par with the Swin transformer☆609Feb 14, 2023Updated 3 years ago
- This is a collection of our NAS and Vision Transformer work.☆1,834Jul 25, 2024Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Official PyTorch Implementation of Long-Short Transformer (NeurIPS 2021).☆228Apr 18, 2022Updated 4 years ago
- DeiT implementation for Q-ViT☆25Apr 21, 2025Updated last year
- [NeurIPS 2021 Spotlight] Official code for "Focal Self-attention for Local-Global Interactions in Vision Transformers"☆558Mar 27, 2022Updated 4 years ago
- [CoRL 2022] SurroundDepth: Entangling Surrounding Views for Self-Supervised Multi-Camera Depth Estimation☆289Feb 9, 2023Updated 3 years ago
- Implementation of TC-Net for iSBIR: Triplet Classification Network for instance-level Sketch Based Image Retrieval.☆21Feb 23, 2020Updated 6 years ago
- [NeurIPS 2022] 4D Unsupervised Object Discovery☆55Dec 5, 2023Updated 2 years ago
- PyTorch implementation of DGECN☆14Jun 28, 2022Updated 3 years ago
- All Points Matter: Entropy-Regularized Distribution Alignment for Weakly-supervised 3D Segmentation (NeurIPS 2023)☆31Nov 3, 2023Updated 2 years ago
- Official implementation for "SimA: Simple Softmax-free Attention for Vision Transformers"☆46Apr 18, 2024Updated 2 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆98Apr 27, 2022Updated 4 years ago
- [NeurIPS 2022 Spotlight] This is the official PyTorch implementation of "EcoFormer: Energy-Saving Attention with Linear Complexity"☆74Nov 15, 2022Updated 3 years ago
- An All-MLP solution for Vision, from Google AI☆1,060Jul 7, 2025Updated 9 months ago
- ☆76Sep 30, 2022Updated 3 years ago
- Pytorch library for fast transformer implementations☆1,769Mar 23, 2023Updated 3 years ago
- MSG-Transformer: Exchanging Local Spatial Information by Manipulating Messenger Tokens (CVPR 2022)☆80Oct 20, 2022Updated 3 years ago
- ☆246Jul 23, 2021Updated 4 years ago
- ☆135Feb 10, 2023Updated 3 years ago
- This is an official implementation for "Contextual Transformer Networks for Visual Recognition".☆538Aug 8, 2021Updated 4 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Official code for paper "On the Connection between Local Attention and Dynamic Depth-wise Convolution" ICLR 2022 Spotlight☆184Nov 17, 2022Updated 3 years ago
- Official code for "Dynamic Token Normalization Improves Vision Transformer", ICLR 2022.☆29May 22, 2022Updated 3 years ago
- Source code for our AAAI'22 paper 《From Dense to Sparse: Contrastive Pruning for Better Pre-trained Language Model Compression》☆25Dec 15, 2021Updated 4 years ago
- This repository contains the code for the paper "TaylorShift: Shifting the Complexity of Self-Attention from Squared to Linear (and Back)…☆14Feb 25, 2026Updated 2 months ago
- ☆17May 4, 2018Updated 7 years ago
- Fixed version of https://github.com/tomguluson92/PRNet_PyTorch☆10Mar 30, 2020Updated 6 years ago
- Official DeiT repository☆4,339Mar 15, 2024Updated 2 years ago