LeapLabTHU / EfficientTrain
1.5−3.0× lossless training or pre-training speedup. An off-the-shelf, easy-to-implement algorithm for the efficient training of foundation visual backbones.
☆218Updated 6 months ago
Alternatives and similar repositories for EfficientTrain:
Users that are interested in EfficientTrain are comparing it to the libraries listed below
- Open source implementation of "Vision Transformers Need Registers"☆165Updated last month
- [NeurIPS 2023] Rank-DETR for High Quality Object Detection☆90Updated last year
- The official repo for [TPAMI'23] "Vision Transformer with Quadrangle Attention"☆198Updated 10 months ago
- [BMVC 2024] PlainMamba: Improving Non-hierarchical Mamba in Visual Recognition☆74Updated 6 months ago
- [ICCV2023] DETR Doesn’t Need Multi-Scale or Locality Design☆195Updated last year
- [CVPR 2024] Official implementation of "ViTamin: Designing Scalable Vision Models in the Vision-language Era"☆197Updated 8 months ago
- The official implementation of "Adapter is All You Need for Tuning Visual Tasks".☆82Updated 6 months ago
- [CVPR 2023] Official repository of Generative Semantic Segmentation☆210Updated last year
- [NeurIPS 2024 Spotlight ⭐️] Parameter-Inverted Image Pyramid Networks (PIIP)☆85Updated last month
- ☆56Updated this week
- Official implementation of SCLIP: Rethinking Self-Attention for Dense Vision-Language Inference☆145Updated 4 months ago
- ☆60Updated 2 years ago
- One summary of efficient segment anything models☆91Updated 6 months ago
- a PyTorch re-implementation of ECCV 2022 paper based on Detectron2: k-means mask Transformer.☆73Updated last year
- This repository is the official implementation of our Autoregressive Pretraining with Mamba in Vision☆69Updated 8 months ago
- [CVPR'23] Hard Patches Mining for Masked Image Modeling☆90Updated last year
- [CVPR 2023] This repository includes the official implementation our paper "Masked Autoencoders Enable Efficient Knowledge Distillers"☆103Updated last year
- [ECCV 2024] Official PyTorch implementation of RoPE-ViT "Rotary Position Embedding for Vision Transformer"☆283Updated 2 months ago
- [ICLR2024 Spotlight] Code Release of CLIPSelf: Vision Transformer Distills Itself for Open-Vocabulary Dense Prediction☆183Updated last year
- [CVPR'24] Multimodal Pathway: Improve Transformers with Irrelevant Data from Other Modalities☆100Updated 11 months ago
- Official Implementation of the CrossMAE paper: Rethinking Patch Dependence for Masked Autoencoders☆100Updated 2 months ago
- (CVPR2023/TPAMI2024) Integrally Pre-Trained Transformer Pyramid Networks -- A Hierarchical Vision Transformer for Masked Image Modeling☆188Updated 7 months ago
- Official implementation of the CVPR 2024 paper ViT-CoMer: Vision Transformer with Convolutional Multi-scale Feature Interaction for Dense…☆271Updated last month
- [CVPR 2023 Highlight] This is the official implementation of "Stitchable Neural Networks".☆248Updated last year
- ☆81Updated last year
- [ECCV2024] Official implementation of paper, "DenseNets Reloaded: Paradigm Shift Beyond ResNets and ViTs".☆142Updated 6 months ago
- This is a PyTorch implementation of “Context AutoEncoder for Self-Supervised Representation Learning"☆101Updated last year
- [ICLR 2025 Spotlight] Vision-RWKV: Efficient and Scalable Visual Perception with RWKV-Like Architectures☆409Updated 2 weeks ago
- Official Code of Paper "Reversible Column Networks" "RevColv2"☆259Updated last year