MatthieuFP / VGAMTLinks
☆11Updated 10 months ago
Alternatives and similar repositories for VGAMT
Users that are interested in VGAMT are comparing it to the libraries listed below
Sorting:
- Code for the ACL 2023 paper Scene Graph as Pivoting: Inference-time Image-free Unsupervised Multimodal Machine Translation with Visual Sc…☆12Updated 2 years ago
- Code for ACL 2022 main conference paper "Neural Machine Translation with Phrase-Level Universal Visual Representations".☆21Updated last year
- The code and data for "Summary-Oriented Vision Modeling for Multimodal Abstractive Summarization"☆10Updated 2 years ago
- ☆13Updated last year
- This code repository is for the accepted ACL2022 paper "On Vision Features in Multimodal Machine Translation". We provide the details and…☆43Updated 2 years ago
- ☆24Updated 4 years ago
- [Paperlist] Awesome paper list of multimodal dialog, including methods, datasets and metrics☆38Updated 7 months ago
- Paper, dataset and code list for multimodal dialogue.☆21Updated 8 months ago
- MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuning☆135Updated 2 years ago
- a multimodal retrieval dataset☆24Updated 2 years ago
- Recent Advances in Visual Dialog☆30Updated 3 years ago
- The Social-IQ 2.0 Challenge Release for the Artificial Social Intelligence Workshop at ICCV '23☆32Updated last year
- Code for EMNLP 2022 main conference paper "Low-resource Neural Machine Translation with Cross-modal Alignment".☆14Updated 2 years ago
- ☆22Updated last year
- This repository contains code to evaluate various multimodal large language models using different instructions across multiple multimoda…☆29Updated 5 months ago
- ☆30Updated 2 years ago
- ☆40Updated 2 years ago
- ☆17Updated 2 years ago
- Code for ACL 2023 paper: Exploring Better Text Image Translation with Multimodal Codebook☆20Updated 3 months ago
- ☆24Updated last year
- Source code and data used in the papers ViQuAE (Lerner et al., SIGIR'22), Multimodal ICT (Lerner et al., ECIR'23) and Cross-modal Retriev…☆38Updated 8 months ago
- NewsCLIPpings: Automatic Generation of Out-of-Context Multimodal Media, EMNLP 2021☆49Updated 2 months ago
- [EMNLP'21] Visual News: Benchmark and Challenges in News Image Captioning☆99Updated last year
- ☆106Updated 3 years ago
- CVPR 2021 Official Pytorch Code for UC2: Universal Cross-lingual Cross-modal Vision-and-Language Pre-training☆34Updated 3 years ago
- This repository provides a comprehensive collection of research papers focused on multimodal representation learning, all of which have b…☆79Updated 2 months ago
- Code for our EMNLP-2022 paper: "Language Prior Is Not the Only Shortcut: A Benchmark for Shortcut Learning in VQA"☆40Updated 2 years ago
- Cross-View Language Modeling: Towards Unified Cross-Lingual Cross-Modal Pre-training (ACL 2023))☆91Updated 2 years ago
- IRFL: Image Recognition of Figurative Language☆11Updated last year
- MuKEA: Multimodal Knowledge Extraction and Accumulation for Knowledge-based Visual Question Answering☆97Updated 2 years ago