LeapLabTHU / EfficientTrain
1.5−3.0× lossless training or pre-training speedup. An off-the-shelf, easy-to-implement algorithm for the efficient training of foundation visual backbones.
☆217Updated 5 months ago
Alternatives and similar repositories for EfficientTrain:
Users that are interested in EfficientTrain are comparing it to the libraries listed below
- Open source implementation of "Vision Transformers Need Registers"☆161Updated this week
- [BMVC 2024] PlainMamba: Improving Non-hierarchical Mamba in Visual Recognition☆72Updated 5 months ago
- [ICLR2024 Spotlight] Code Release of CLIPSelf: Vision Transformer Distills Itself for Open-Vocabulary Dense Prediction☆181Updated 11 months ago
- The official implementation of "Adapter is All You Need for Tuning Visual Tasks".☆77Updated 5 months ago
- Official PyTorch implementation of DiffuseMix : Label-Preserving Data Augmentation with Diffusion Models (CVPR'2024)☆101Updated 6 months ago
- One summary of efficient segment anything models☆87Updated 5 months ago
- Vision-RWKV: Efficient and Scalable Visual Perception with RWKV-Like Architectures☆398Updated 2 months ago
- ☆58Updated last year
- Code Implementation of EfficientVMamba☆193Updated 9 months ago
- Official implementation of SCLIP: Rethinking Self-Attention for Dense Vision-Language Inference☆143Updated 3 months ago
- [ICCV2023] DETR Doesn’t Need Multi-Scale or Locality Design☆193Updated last year
- [CVPR 2023] Official repository of Generative Semantic Segmentation☆210Updated last year
- The official repo for [TPAMI'23] "Vision Transformer with Quadrangle Attention"☆194Updated 9 months ago
- Official Code of Paper "Reversible Column Networks" "RevColv2"☆256Updated last year
- An efficient pytorch implementation of selective scan in one file, works with both cpu and gpu, with corresponding mathematical derivatio…☆78Updated 10 months ago
- [NeurIPS 2024 Spotlight ⭐️] Parameter-Inverted Image Pyramid Networks (PIIP)☆81Updated 2 weeks ago
- Official implement for ICML2023 paper: "A Closer Look at Self-Supervised Lightweight Vision Transformers"☆122Updated last year
- [CVPR 2024] Code for "Improving the Generalization of Segmentation Foundation Model under Distribution Shift via Weakly Supervised Adapta…☆152Updated 5 months ago
- [Survey] Masked Modeling for Self-supervised Representation Learning on Vision and Beyond (https://arxiv.org/abs/2401.00897)☆314Updated 3 months ago
- [CVPR 2024] Official implementation of "ViTamin: Designing Scalable Vision Models in the Vision-language Era"☆196Updated 7 months ago
- ☆55Updated 7 months ago
- This is a PyTorch implementation of “Context AutoEncoder for Self-Supervised Representation Learning"☆98Updated last year
- [NeurIPS'23] DropPos: Pre-Training Vision Transformers by Reconstructing Dropped Positions☆60Updated 9 months ago
- Recognize Any Regions☆122Updated last month
- [CVPR 2023 Highlight] This is the official implementation of "Stitchable Neural Networks".☆247Updated last year
- [NeurIPS 2023] Rank-DETR for High Quality Object Detection☆88Updated last year
- [ECCV2024] Official implementation of paper, "DenseNets Reloaded: Paradigm Shift Beyond ResNets and ViTs".☆139Updated 5 months ago
- [CVPR 2023] This repository includes the official implementation our paper "Masked Autoencoders Enable Efficient Knowledge Distillers"☆103Updated last year
- Official repository of Slide-Transformer (CVPR2023)☆161Updated 5 months ago
- Code for paper LocalMamba: Visual State Space Model with Windowed Selective Scan☆224Updated 8 months ago