wanng-ide / VQA_to_multimodal_survey
Update 2020
☆73Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for VQA_to_multimodal_survey
- natual language guided image captioning☆77Updated 9 months ago
- SmallCap: Lightweight Image Captioning Prompted with Retrieval Augmentation☆95Updated 9 months ago
- All-In-One VLM: Image + Video + Transfer to Other Languages / Domains (TPAMI 2023)☆141Updated 3 months ago
- Recent Advances in Vision and Language Pre-training (VLP)☆288Updated last year
- ☆83Updated 2 years ago
- [Paper][AAAI2024]Structure-CLIP: Towards Scene Graph Knowledge to Enhance Multi-modal Structured Representations☆114Updated 5 months ago
- The official GitHub page for ''Evaluating Object Hallucination in Large Vision-Language Models''☆182Updated 7 months ago
- [ICLR 2023] This is the code repo for our ICLR‘23 paper "Universal Vision-Language Dense Retrieval: Learning A Unified Representation Spa…☆48Updated 4 months ago
- METER: A Multimodal End-to-end TransformER Framework☆362Updated 2 years ago
- A lightweight codebase for referring expression comprehension and segmentation☆52Updated 2 years ago
- MuKEA: Multimodal Knowledge Extraction and Accumulation for Knowledge-based Visual Question Answering☆88Updated last year
- Cross-View Language Modeling: Towards Unified Cross-Lingual Cross-Modal Pre-training (ACL 2023))☆88Updated last year
- [MIR-2023-Survey] A continuously updated paper list for multi-modal pre-trained big models☆279Updated 3 weeks ago
- MixGen: A New Multi-Modal Data Augmentation☆116Updated last year
- ☆31Updated last month
- Official implementation of "Open-Vocabulary Multi-Label Classification via Multi-Modal Knowledge Transfer".☆119Updated 2 weeks ago
- 前沿论文持续更新--视频时刻定位 or 时域语言定位 or 视频片段检索。☆236Updated last year
- Source code for EMNLP 2022 paper “PEVL: Position-enhanced Pre-training and Prompt Tuning for Vision-language Models”☆47Updated 2 years ago
- code for TCL: Vision-Language Pre-Training with Triple Contrastive Learning, CVPR 2022☆260Updated last month
- mPLUG-HalOwl: Multimodal Hallucination Evaluation and Mitigating☆79Updated 9 months ago
- Coarse-to-Fine Reasoning for Visual Question Answering (CVPRW'22)☆43Updated 2 years ago
- Implementation for CVPR 2022 paper " Injecting Semantic Concepts into End-to-End Image Captionin".☆41Updated 2 years ago
- Improving Visual Grounding with Visual-Linguistic Verification and Iterative Reasoning, CVPR 2022☆91Updated last year
- [NeurIPS 2023] Self-Chained Image-Language Model for Video Localization and Question Answering☆178Updated 10 months ago
- A curated list of Multimodal Captioning related research(including image captioning, video captioning, and text captioning)☆108Updated 2 years ago
- MMICL, a state-of-the-art VLM with the in context learning ability from ICL, PKU☆41Updated last year
- [CVPR23] A cascaded diffusion captioning model with a novel semantic-conditional diffusion process that upgrades conventional diffusion m…☆56Updated 5 months ago
- This is the first released survey paper on hallucinations of large vision-language models (LVLMs). To keep track of this field and contin…☆47Updated 3 months ago
- Official implementation of HawkEye: Training Video-Text LLMs for Grounding Text in Videos☆34Updated 6 months ago
- Official implementation of "ConZIC: Controllable Zero-shot Image Captioning by Sampling-Based Polishing"☆73Updated last year