LeapLabTHU / EfficientTrain
1.5−3.0× lossless training or pre-training speedup. An off-the-shelf, easy-to-implement algorithm for the efficient training of foundation visual backbones.
☆209Updated 2 months ago
Related projects ⓘ
Alternatives and complementary repositories for EfficientTrain
- One summary of efficient segment anything models☆73Updated 3 months ago
- The official implementation of "Adapter is All You Need for Tuning Visual Tasks".☆72Updated 2 months ago
- [ICCV2023] DETR Doesn’t Need Multi-Scale or Locality Design☆191Updated last year
- ☆48Updated 5 months ago
- ☆58Updated last year
- (CVPR2023/TPAMI2024) Integrally Pre-Trained Transformer Pyramid Networks -- A Hierarchical Vision Transformer for Masked Image Modeling☆175Updated 3 months ago
- [ICLR2024 Spotlight] Code Release of CLIPSelf: Vision Transformer Distills Itself for Open-Vocabulary Dense Prediction☆168Updated 9 months ago
- Official Code of Paper "Reversible Column Networks" "RevColv2"☆250Updated last year
- Official PyTorch implementation of DiffuseMix : Label-Preserving Data Augmentation with Diffusion Models (CVPR'2024)☆91Updated 4 months ago
- The official repo for [TPAMI'23] "Vision Transformer with Quadrangle Attention"☆177Updated 7 months ago
- Open source implementation of "Vision Transformers Need Registers"☆143Updated last week
- [CVPR 2023 Highlight] This is the official implementation of "Stitchable Neural Networks".☆244Updated last year
- ☆244Updated last year
- [BMVC 2024] PlainMamba: Improving Non-hierarchical Mamba in Visual Recognition☆70Updated 3 months ago
- [CVPR 2024] Official implementation of "ViTamin: Designing Scalable Vision Models in the Vision-language Era"☆175Updated 5 months ago
- [NeurIPS 2023] Rank-DETR for High Quality Object Detection☆87Updated last year
- Official implementation of the CVPR 2024 paper ViT-CoMer: Vision Transformer with Convolutional Multi-scale Feature Interaction for Dense…☆231Updated last month
- [ECCV 2024] Official PyTorch implementation of RoPE-ViT "Rotary Position Embedding for Vision Transformer"☆213Updated 3 weeks ago
- ImageNet-1K data download, processing for using as a dataset☆65Updated last year
- Recognize Any Regions☆118Updated last month
- Official implementation of SCLIP: Rethinking Self-Attention for Dense Vision-Language Inference☆131Updated last month
- [CVPR 2023] This repository includes the official implementation our paper "Masked Autoencoders Enable Efficient Knowledge Distillers"☆99Updated last year
- [ECCV 2024] Isomorphic Pruning for Vision Models☆53Updated 3 months ago
- [CVPR 2023] Official repository of Generative Semantic Segmentation☆205Updated last year
- Project Page for "Multi-Task Dense Prediction via Mixture of Low-Rank Experts"☆56Updated last month
- Code for paper LocalMamba: Visual State Space Model with Windowed Selective Scan☆204Updated 6 months ago
- 'NKD and USKD' (ICCV 2023) and 'ViTKD' (CVPRW 2024)☆217Updated last year
- Official implement for ICML2023 paper: "A Closer Look at Self-Supervised Lightweight Vision Transformers"☆115Updated last year
- Official PyTorch implementation of Which Tokens to Use? Investigating Token Reduction in Vision Transformers presented at ICCV 2023 NIVT …☆31Updated last year
- Official implementation of paper titled "GroupMamba: Parameter-Efficient and Accurate Group Visual State Space Model"☆61Updated 4 months ago