allenai / gpv2
☆32Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for gpv2
- MLPs for Vision and Langauge Modeling (Coming Soon)☆27Updated 2 years ago
- [EMNLP 2021] Code and data for our paper "Vision-and-Language or Vision-for-Language? On Cross-Modal Influence in Multimodal Transformers…☆20Updated 2 years ago
- Code for paper "Point and Ask: Incorporating Pointing into Visual Question Answering"☆18Updated 2 years ago
- PyTorch code for "Perceiver-VL: Efficient Vision-and-Language Modeling with Iterative Latent Attention" (WACV 2023)☆32Updated last year
- Code for 'Why is Winoground Hard? Investigating Failures in Visuolinguistic Compositionality', EMNLP 2022☆30Updated last year
- Repository for the paper "Data Efficient Masked Language Modeling for Vision and Language".☆17Updated 3 years ago
- Source code for the paper "Prefix Language Models are Unified Modal Learners"☆42Updated last year
- PyTorch code for Improving Commonsense in Vision-Language Models via Knowledge Graph Riddles (DANCE)☆24Updated last year
- ☆29Updated 2 years ago
- Pytorch version of DeCEMBERT: Learning from Noisy Instructional Videos via Dense Captions and Entropy Minimization (NAACL 2021)☆17Updated last year
- The SVO-Probes Dataset for Verb Understanding☆31Updated 2 years ago
- CVPR 2022 (Oral) Pytorch Code for Unsupervised Vision-and-Language Pre-training via Retrieval-based Multi-Granular Alignment☆22Updated 2 years ago
- Research code for "Training Vision-Language Transformers from Captions Alone"☆33Updated 2 years ago
- Command-line tool for downloading and extending the RedCaps dataset.☆45Updated 10 months ago
- https://arxiv.org/abs/2209.15162☆48Updated last year
- Pytorch version of VidLanKD: Improving Language Understanding viaVideo-Distilled Knowledge Transfer (NeurIPS 2021))☆56Updated last year
- LV-BERT: Exploiting Layer Variety for BERT (Findings of ACL 2021)☆18Updated last year
- Code and data for the project "Visually grounded continual learning of compositional semantics"☆21Updated last year
- This code provides a PyTorch implementation for OTTER (Optimal Transport distillation for Efficient zero-shot Recognition), as described …☆64Updated 2 years ago
- The released data for paper "Measuring and Improving Chain-of-Thought Reasoning in Vision-Language Models".☆32Updated last year
- Data and code for NeurIPS 2021 Paper "IconQA: A New Benchmark for Abstract Diagram Understanding and Visual Language Reasoning".☆49Updated 9 months ago
- Official Code Release for "Diagnosing and Rectifying Vision Models using Language" (ICLR 2023)☆32Updated last year
- Official repository for the General Robust Image Task (GRIT) Benchmark☆50Updated last year
- ☆11Updated 2 years ago
- Rethinking Nearest Neighbors for Visual Classification☆31Updated 2 years ago
- Sparkles: Unlocking Chats Across Multiple Images for Multimodal Instruction-Following Models☆41Updated 4 months ago
- ☆29Updated last year
- ☆22Updated 2 years ago
- CLIP4IDC: CLIP for Image Difference Captioning (AACL 2022)☆27Updated last year