wanng-ide / VQA_to_multimodal_survey

Related projects ⓘ

Alternatives and complementary repositories for VQA_to_multimodal_survey

• zjukg / Structure-CLIP
  [Paper][AAAI2024]Structure-CLIP: Towards Scene Graph Knowledge to Enhance Multi-modal Structured Representations
  ☆113Updated 4 months ago
• phellonchen / awesome-Vision-and-Language-Pre-training
  Recent Advances in Vision and Language Pre-training (VLP)
  ☆288Updated last year
• sunanhe / MKT
  Official implementation of "Open-Vocabulary Multi-Label Classification via Multi-Modal Knowledge Transfer".
  ☆119Updated this week
• zengyan-97 / X2-VLM
  All-In-One VLM: Image + Video + Transfer to Other Languages / Domains (TPAMI 2023)
  ☆140Updated 2 months ago
• luogen1996 / SimREC
  A lightweight codebase for referring expression comprehension and segmentation
  ☆52Updated 2 years ago
• thunlp / PEVL
  Source code for EMNLP 2022 paper “PEVL: Position-enhanced Pre-training and Prompt Tuning for Vision-language Models”
  ☆47Updated 2 years ago
• OpenMatch / UniVL-DR
  [ICLR 2023] This is the code repo for our ICLR‘23 paper "Universal Vision-Language Dense Retrieval: Learning A Unified Representation Spa…
  ☆43Updated 4 months ago
• wangxiao5791509 / MultiModal_BigModels_Survey
  [MIR-2023-Survey] A continuously updated paper list for multi-modal pre-trained big models
  ☆280Updated last week
• uta-smile / TCL
  code for TCL: Vision-Language Pre-Training with Triple Contrastive Learning, CVPR 2022
  ☆260Updated last month
• RUCAIBox / POPE
  The official GitHub page for ''Evaluating Object Hallucination in Large Vision-Language Models''
  ☆178Updated 7 months ago
• VRU-NExT / VideoQA
  ☆78Updated 2 years ago
• RitaRamo / smallcap
  SmallCap: Lightweight Image Captioning Prompted with Retrieval Augmentation
  ☆93Updated 8 months ago
• linhuixiao / CLIP-VG
  [TMM 2023] Self-paced Curriculum Adapting of CLIP for Visual Grounding.
  ☆107Updated 3 months ago
• LeapLabTHU / Pseudo-Q
  [CVPR 2022] Pseudo-Q: Generating Pseudo Language Queries for Visual Grounding
  ☆144Updated 3 months ago
• yaolinli / DeCo
  ☆23Updated 4 months ago
• Yushi-Hu / PromptCap
  natual language guided image captioning
  ☆77Updated 8 months ago
• amazon-science / mix-generation
  MixGen: A New Multi-Modal Data Augmentation
  ☆115Updated last year
• joeyz0z / ConZIC
  Official implementation of "ConZIC: Controllable Zero-shot Image Captioning by Sampling-Based Polishing"
  ☆73Updated last year
• X-PLUG / mPLUG-HalOwl
  mPLUG-HalOwl: Multimodal Hallucination Evaluation and Mitigating
  ☆79Updated 9 months ago
• buxiangzhiren / DDCap
  ☆85Updated last year
• GT-RIPL / Xmodal-Ctx
  Official PyTorch implementation of our CVPR 2022 paper: Beyond a Pre-Trained Object Detector: Cross-Modal Textual and Visual Context for …
  ☆60Updated 2 years ago
• sMamooler / CLIP_Explainability
  code for studying OpenAI's CLIP explainability
  ☆26Updated 2 years ago
• zdou0830 / METER
  METER: A Multimodal End-to-end TransformER Framework
  ☆361Updated last year
• jianjieluo / SCD-Net
  [CVPR23] A cascaded diffusion captioning model with a novel semantic-conditional diffusion process that upgrades conventional diffusion m…
  ☆56Updated 4 months ago
• zengyan-97 / CCLM
  Cross-View Language Modeling: Towards Unified Cross-Lingual Cross-Modal Pre-training (ACL 2023))
  ☆87Updated last year
• BAAI-DCAI / Visual-Instruction-Tuning
  SVIT: Scaling up Visual Instruction Tuning
  ☆163Updated 4 months ago
• CrossmodalGroup / NAAF
  Implementation of our CVPR2022 paper, Negative-Aware Attention Framework for Image-Text Matching.
  ☆109Updated last year
• yangli18 / VLTVG
  Improving Visual Grounding with Visual-Linguistic Verification and Iterative Reasoning, CVPR 2022
  ☆91Updated last year
• JiuTian-VL / JiuTian-LION
  [CVPR 2024] LION: Empowering Multimodal Large Language Model with Dual-Level Visual Knowledge
  ☆122Updated 3 months ago
• aioz-ai / CFR_VQA
  Coarse-to-Fine Reasoning for Visual Question Answering (CVPRW'22)
  ☆43Updated 2 years ago