MILVLG / rositaView external linksLinks
ROSITA: Enhancing Vision-and-Language Semantic Alignments via Cross- and Intra-modal Knowledge Integration
☆56Jun 13, 2023Updated 2 years ago
Alternatives and similar repositories for rosita
Users that are interested in rosita are comparing it to the libraries listed below
Sorting:
- A PyTorch implementation of the paper Multimodal Transformer with Multiview Visual Representation for Image Captioning☆25Sep 4, 2020Updated 5 years ago
- [Paper][ISWC 2021] Zero-shot Visual Question Answering using Knowledge Graph☆72Feb 9, 2024Updated 2 years ago
- ☆10Jul 23, 2021Updated 4 years ago
- A reading list of papers about Visual Question Answering.☆35Aug 17, 2022Updated 3 years ago
- ☆27Oct 7, 2021Updated 4 years ago
- A PyTorch reimplementation of bottom-up-attention models☆302Apr 7, 2022Updated 3 years ago
- The official code for "Visual Relationship Detection with Visual-Linguistic Knowledge from Multimodal Representations" (IEEE Access, 2021…☆17Oct 21, 2022Updated 3 years ago
- Code for Knowledge-Embedded Routing Network for Scene Graph Generation (CVPR 2019)☆123Aug 17, 2022Updated 3 years ago
- Implementation of ConceptBert: Concept-Aware Representation for Visual Question Answering☆31Apr 30, 2024Updated last year
- project page for VinVL☆359Jul 26, 2023Updated 2 years ago
- source code and pre-trained/fine-tuned checkpoint for NAACL 2021 paper LightningDOT☆72Nov 14, 2022Updated 3 years ago
- Official code repo for "ProTo: program-guided Transformers for Program-guided Tasks☆21Apr 15, 2022Updated 3 years ago
- Code for paper: Visual-Semantic Graph Attention Networks for Human-Object Interaction Detection. Project page: http://www.juanrojas.net/v…☆19Mar 3, 2021Updated 4 years ago
- Grid features pre-training code for visual question answering☆269Sep 17, 2021Updated 4 years ago
- Code for ViLBERTScore in EMNLP Eval4NLP☆18Oct 27, 2022Updated 3 years ago
- ☆22Aug 10, 2020Updated 5 years ago
- [ECCV'22 Poster] Explicit Image Caption Editing☆22Nov 30, 2022Updated 3 years ago
- ☆25Jun 25, 2021Updated 4 years ago
- Deep Modular Co-Attention Networks for Visual Question Answering☆458Dec 16, 2020Updated 5 years ago
- [ICLR 2022] code for "How Much Can CLIP Benefit Vision-and-Language Tasks?" https://arxiv.org/abs/2107.06383☆421Oct 28, 2022Updated 3 years ago
- Remote sensing Image Captioning is a special case of Image Captioning which solves the difficulties in processing the remote sensing imag…☆11Jun 16, 2021Updated 4 years ago
- The good practice in the VQA system such as pos-tag attention, structed triplet learning and triplet attention is very general and can be…☆19Jan 23, 2018Updated 8 years ago
- Implementation of Mutan+ArticleNet on OKVQA☆10Jan 11, 2021Updated 5 years ago
- implement gat with batch☆10Nov 28, 2020Updated 5 years ago
- Code for GLAT (Global Local Transformer), ECCV 2020 "Learning Visual Commonsense for Robust Scene Graph Generation"☆11Dec 16, 2020Updated 5 years ago
- ☆10Apr 26, 2023Updated 2 years ago
- Oscar and VinVL☆1,052Aug 28, 2023Updated 2 years ago
- MFURLN relationship detection method☆21May 17, 2020Updated 5 years ago
- A collection of models for image<->text generation in ACM MM 2021.☆67Oct 31, 2021Updated 4 years ago
- Implementation of CVPR 2023 paper "Prompting Large Language Models with Answer Heuristics for Knowledge-based Visual Question Answering".☆278Jun 14, 2025Updated 8 months ago
- ☆30May 20, 2022Updated 3 years ago
- This repository contains the code for our CVPR 2022 paper on "Integrating Language Guidance into Vision-based Deep Metric Learning".☆44Aug 9, 2022Updated 3 years ago
- Official Pytorch Implementation for the paper 'SUPER-ADAM: Faster and Universal Framework of Adaptive Gradients'☆17Jan 12, 2022Updated 4 years ago
- Code for WACV 2021 Paper "Meta Module Network for Compositional Visual Reasoning"☆43May 13, 2021Updated 4 years ago
- ☆10Jun 1, 2019Updated 6 years ago
- ☆18Apr 16, 2025Updated 9 months ago
- GPT as Knowledger Worker (or if you really want, GPT Sorta' Takes the CPA Exam)☆13Jan 24, 2023Updated 3 years ago
- ☆10Oct 14, 2020Updated 5 years ago
- Segment graph convolutional neural network for relation classification. Paper in JAMIA.☆10May 13, 2019Updated 6 years ago