FudanDISC / weakly-supervised-mVLP
Implementation of our ACL2023 paper: Unifying Cross-Lingual and Cross-Modal Modeling Towards Weakly Supervised Multilingual Vision-Language Pre-training
☆15Updated last year
Related projects ⓘ
Alternatives and complementary repositories for weakly-supervised-mVLP
- [EMNLP 2024] mDPO: Conditional Preference Optimization for Multimodal Large Language Models.☆22Updated 3 weeks ago
- Source code and data used in the papers ViQuAE (Lerner et al., SIGIR'22), Multimodal ICT (Lerner et al., ECIR'23) and Cross-modal Retriev…☆26Updated 9 months ago
- ☆27Updated last year
- ☆17Updated 4 months ago
- ICCV 2023 (Oral) Open-domain Visual Entity Recognition Towards Recognizing Millions of Wikipedia Entities☆32Updated 2 months ago
- ☆9Updated 2 months ago
- ☆15Updated last year
- ☆23Updated 3 years ago
- ☆32Updated last year
- Paper, dataset and code list for multimodal dialogue.☆19Updated 2 months ago
- EMNLP2023 - InfoSeek: A New VQA Benchmark focus on Visual Info-Seeking Questions☆16Updated 5 months ago
- [ICML 2022] Code and data for our paper "IGLUE: A Benchmark for Transfer Learning across Modalities, Tasks, and Languages"☆49Updated last year
- This code repository is for the accepted ACL2022 paper "On Vision Features in Multimodal Machine Translation". We provide the details and…☆44Updated 2 years ago
- ☆24Updated last year
- ☆25Updated this week
- ☆15Updated 2 years ago
- [ICLR 2023] This is the code repo for our ICLR‘23 paper "Universal Vision-Language Dense Retrieval: Learning A Unified Representation Spa…☆43Updated 4 months ago
- NAACL 2022: MCSE: Multimodal Contrastive Learning of Sentence Embeddings☆53Updated 5 months ago
- Code for ACL 2022 main conference paper "Neural Machine Translation with Phrase-Level Universal Visual Representations".☆21Updated last year
- Source code for Truth-Aware Context Selection: Mitigating the Hallucinations of Large Language Models Being Misled by Untruthful Contexts☆14Updated 2 months ago
- Code and data for ImageCoDe, a contextual vison-and-language benchmark☆39Updated 8 months ago
- Code for our EMNLP-2022 paper: "Towards Robust Visual Question Answering: Making the Most of Biased Samples via Contrastive Learning"☆12Updated last year
- This repository contains code to evaluate various multimodal large language models using different instructions across multiple multimoda…☆24Updated 6 months ago
- Code for EMNLP 2022 main conference paper "Low-resource Neural Machine Translation with Cross-modal Alignment".☆14Updated last year
- Official repository for the A-OKVQA dataset☆63Updated 6 months ago
- [ACL 2024] FLEUR: An Explainable Reference-Free Evaluation Metric for Image Captioning Using a Large Multimodal Model☆9Updated 2 months ago
- a multimodal retrieval dataset☆22Updated last year
- Corpus to accompany: "Do Androids Laugh at Electric Sheep? Humor "Understanding" Benchmarks from The New Yorker Caption Contest"☆52Updated this week
- ☆13Updated 11 months ago