Source code for "On the Relationship between Self-Attention and Convolutional Layers"
☆1,123Jan 10, 2023Updated 3 years ago
Alternatives and similar repositories for attention-cnn
Users that are interested in attention-cnn are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Implementing Stand-Alone Self-Attention in Vision Models using Pytorch☆459Feb 13, 2020Updated 6 years ago
- Exploring Self-attention for Image Recognition, CVPR2020.☆752Jun 15, 2020Updated 6 years ago
- Implementing Attention Augmented Convolutional Networks using Pytorch☆653Jan 26, 2022Updated 4 years ago
- ResNeSt: Split-Attention Networks☆3,260Sep 11, 2026Updated last month
- Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less compute☆1,530Nov 18, 2020Updated 5 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Official DeiT repository☆4,348Mar 15, 2024Updated 2 years ago
- pip install antialiased-cnns to improve stability and accuracy☆1,687Apr 8, 2024Updated 2 years ago
- End-to-End Object Detection with Transformers☆15,351Mar 12, 2024Updated 2 years ago
- Scaling and Benchmarking Self-Supervised Visual Representation Learning☆588Oct 12, 2021Updated 5 years ago
- PyTorch implementation of Contrastive Learning methods☆1,992Oct 4, 2023Updated 3 years ago
- [arXiv 2019] "Contrastive Multiview Coding", also contains implementations for MoCo and InstDis☆1,338Nov 10, 2020Updated 5 years ago
- Code for our paper: "Regularity Normalization: Neuroscience-Inspired Unsupervised Attention across Neural Network Layers".☆20Dec 28, 2021Updated 4 years ago
- GCNet: Non-local Networks Meet Squeeze-Excitation Networks and Beyond☆1,220Feb 16, 2021Updated 5 years ago
- On the Variance of the Adaptive Learning Rate and Beyond☆2,547Jul 31, 2021Updated 5 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- PyTorch implementation of MoCo: https://arxiv.org/abs/1911.05722☆5,137Feb 3, 2026Updated 8 months ago
- Official Implementation of 'Fast AutoAugment' in PyTorch.☆1,604Jun 16, 2021Updated 5 years ago
- Official implementation of PVT series☆1,909Oct 27, 2022Updated 3 years ago
- A curated list of awesome self-supervised methods☆6,434Feb 24, 2026Updated 7 months ago
- Pytorch implementation of convolutional neural network visualization techniques☆8,241Jan 1, 2025Updated last year
- PyTorch implementation of SwAV https//arxiv.org/abs/2006.09882☆2,093Apr 13, 2023Updated 3 years ago
- Examples of using sparse attention, as in "Generating Long Sequences with Sparse Transformers"☆1,613Aug 12, 2020Updated 6 years ago
- Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Py…☆25,552Updated this week
- A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch☆9,003Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A PyTorch implementation of EfficientNet☆8,220Apr 8, 2022Updated 4 years ago
- ☆12,747Oct 1, 2026Updated 2 weeks ago
- Official repository for the "Big Transfer (BiT): General Visual Representation Learning" paper.☆1,541Jul 30, 2024Updated 2 years ago
- The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights --…☆37,226Updated this week
- OpenMMLab Self-Supervised Learning Toolbox and Benchmark☆3,305Jun 25, 2023Updated 3 years ago
- SimCLRv2 - Big Self-Supervised Models are Strong Semi-Supervised Learners☆4,503May 22, 2023Updated 3 years ago
- SCOPS: Self-Supervised Co-Part Segmentation (CVPR'19)☆219Dec 8, 2022Updated 3 years ago
- [ICLR 2020] Once for All: Train One Network and Specialize it for Efficient Deployment☆1,954Dec 14, 2023Updated 2 years ago
- [CVPR2021, PAMI2023] End-to-End Object Detection with Learnable Proposal☆1,346Apr 30, 2023Updated 3 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- CCNet: Criss-Cross Attention for Semantic Segmentation (TPAMI 2020 & ICCV 2019).☆1,486Mar 19, 2021Updated 5 years ago
- Codebase for Image Classification Research, written in PyTorch.☆2,161Mar 20, 2024Updated 2 years ago
- PySlowFast: video understanding codebase from FAIR for reproducing state-of-the-art video models.☆7,434Mar 16, 2026Updated 7 months ago
- torch-optimizer -- collection of optimizers for Pytorch☆3,172Mar 22, 2024Updated 2 years ago
- Reformer, the efficient Transformer, in Pytorch☆2,195Jun 21, 2023Updated 3 years ago
- Count the MACs / FLOPs of your PyTorch model.☆5,082Jul 8, 2024Updated 2 years ago
- Deformable DETR: Deformable Transformers for End-to-End Object Detection.☆4,027May 16, 2024Updated 2 years ago