IntelLabs / VL-InterpreTLinks
Visual Language Transformer Interpreter - An interactive visualization tool for interpreting vision-language transformers
☆94Updated last year
Alternatives and similar repositories for VL-InterpreT
Users that are interested in VL-InterpreT are comparing it to the libraries listed below
Sorting:
- ☆120Updated 2 years ago
- Coarse-to-Fine Vision-Language Pre-training with Fusion in the Backbone☆129Updated last year
- Filtering, Distillation, and Hard Negatives for Vision-Language Pre-Training☆138Updated 2 years ago
- NLX-GPT: A Model for Natural Language Explanations in Vision and Vision-Language Tasks, CVPR 2022 (Oral)☆48Updated last year
- Code and data for ImageCoDe, a contextual vison-and-language benchmark☆40Updated last year
- Patching open-vocabulary models by interpolating weights☆91Updated last year
- PyTorch code for "VL-Adapter: Parameter-Efficient Transfer Learning for Vision-and-Language Tasks" (CVPR2022)☆205Updated 2 years ago
- Code for the paper titled "CiT Curation in Training for Effective Vision-Language Data".☆78Updated 2 years ago
- The SVO-Probes Dataset for Verb Understanding☆31Updated 3 years ago
- Official Code Release for "Diagnosing and Rectifying Vision Models using Language" (ICLR 2023)☆33Updated 2 years ago
- Implementation for the paper "Reliable Visual Question Answering Abstain Rather Than Answer Incorrectly" (ECCV 2022: https//arxiv.org/abs…☆35Updated 2 years ago
- MetaShift: A Dataset of Datasets for Evaluating Contextual Distribution Shifts and Training Conflicts (ICLR 2022)☆109Updated 2 years ago
- Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities☆78Updated 3 years ago
- [CVPR 2023] Learning Visual Representations via Language-Guided Sampling☆149Updated 2 years ago
- This code provides a PyTorch implementation for OTTER (Optimal Transport distillation for Efficient zero-shot Recognition), as described …☆69Updated 3 years ago
- [NeurIPS 2023] A faithful benchmark for vision-language compositionality☆82Updated last year
- Code for 'Why is Winoground Hard? Investigating Failures in Visuolinguistic Compositionality', EMNLP 2022☆30Updated 2 years ago
- Code, data, models for the Sherlock corpus☆58Updated 2 years ago
- Multimodal Masked Autoencoders (M3AE): A JAX/Flax Implementation☆104Updated 5 months ago
- Reliably download millions of images efficiently☆116Updated 4 years ago
- A task-agnostic vision-language architecture as a step towards General Purpose Vision☆92Updated 4 years ago
- PyTorch code for MUST☆107Updated 3 months ago
- Command-line tool for downloading and extending the RedCaps dataset.☆48Updated last year
- ☆29Updated 2 years ago
- ☆227Updated last year
- [TACL'23] VSR: A probing benchmark for spatial undersranding of vision-language models.☆127Updated 2 years ago
- https://arxiv.org/abs/2209.15162☆50Updated 2 years ago
- ☆59Updated last year
- Experiments and data for the paper "When and why vision-language models behave like bags-of-words, and what to do about it?" Oral @ ICLR …☆280Updated 2 years ago
- Mind the Gap: Understanding the Modality Gap in Multi-modal Contrastive Representation Learning☆158Updated 2 years ago