hila-chefer / RobustViT
[NeurIPS 2022] Official PyTorch implementation of Optimizing Relevance Maps of Vision Transformers Improves Robustness. This code allows to finetune the explainability maps of Vision Transformers to enhance robustness.
☆127Updated last year
Related projects ⓘ
Alternatives and complementary repositories for RobustViT
- A task-agnostic vision-language architecture as a step towards General Purpose Vision☆92Updated 3 years ago
- [CVPR 2023] Learning Visual Representations via Language-Guided Sampling☆145Updated last year
- understanding model mistakes with human annotations☆105Updated last year
- ☆178Updated last year
- Code release for "Improved baselines for vision-language pre-training"☆57Updated 6 months ago
- Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities☆78Updated 2 years ago
- Reproducible scaling laws for contrastive language-image learning (https://arxiv.org/abs/2212.07143)☆153Updated 11 months ago
- Visual Language Transformer Interpreter - An interactive visualization tool for interpreting vision-language transformers☆86Updated last year
- Patching open-vocabulary models by interpolating weights☆90Updated last year
- Code and models for the paper "The effectiveness of MAE pre-pretraining for billion-scale pretraining" https://arxiv.org/abs/2303.13496☆81Updated 3 months ago
- PyTorch code for MUST☆105Updated last year
- Official repository for "Revisiting Weakly Supervised Pre-Training of Visual Perception Models". https://arxiv.org/abs/2201.08371.☆173Updated 2 years ago
- Filtering, Distillation, and Hard Negatives for Vision-Language Pre-Training☆132Updated last year
- MetaShift: A Dataset of Datasets for Evaluating Contextual Distribution Shifts and Training Conflicts (ICLR 2022)☆108Updated 2 years ago
- Probing the representations of Vision Transformers.☆316Updated 2 years ago
- ☆50Updated 2 years ago
- A PyTorch implementation of Mugs proposed by our paper "Mugs: A Multi-Granular Self-Supervised Learning Framework".☆83Updated 9 months ago
- Implementation of MaMMUT, a simple vision-encoder text-decoder architecture for multimodal tasks from Google, in Pytorch☆97Updated last year
- [NeurIPS 2023] This repository includes the official implementation of our paper "An Inverse Scaling Law for CLIP Training"☆298Updated 5 months ago
- PixMix: Dreamlike Pictures Comprehensively Improve Safety Measures (CVPR 2022)☆101Updated 2 years ago
- This code provides a PyTorch implementation for OTTER (Optimal Transport distillation for Efficient zero-shot Recognition), as described …☆64Updated 2 years ago
- HIRL: A General Framework for Hierarchical Image Representation Learning (http://arxiv.org/abs/2205.13159)☆40Updated 2 years ago
- ☆113Updated last year
- ☆154Updated 2 years ago
- This is a offical PyTorch/GPU implementation of SupMAE.☆77Updated 2 years ago
- An ever-growing playground of notebooks showcasing CLIP's impressive zero-shot capabilities☆154Updated 2 years ago
- A compilation of network architectures for vision and others without usage of self-attention mechanism☆77Updated last year
- CLIP Object Detection, search object on image using natural language #Zeroshot #Unsupervised #CLIP #ODS☆138Updated 2 years ago
- Introduction and scripts for the paper "PartImageNet: A Large, High-Quality Dataset of Parts" (Ju He, Shuo Yang, Shaokang Yang, Adam Kort…☆117Updated last year
- ☆47Updated 3 years ago