Alternatives and similar repositories for SimVLM

Users that are interested in SimVLM are comparing it to the libraries listed below

• ilkerkesen / frozen
  A PyTorch implementation of Multimodal Few-Shot Learning with Frozen Language Models with OPT.
  ☆43Updated 3 years ago
• amazon-science / mix-generation
  MixGen: A New Multi-Modal Data Augmentation
  ☆126Updated 2 years ago
• uta-smile / TCL
  code for TCL: Vision-Language Pre-Training with Triple Contrastive Learning, CVPR 2022
  ☆265Updated 11 months ago
• limanling / clip-event
  ☆106Updated 3 years ago
• ylsung / VL_adapter
  PyTorch code for "VL-Adapter: Parameter-Efficient Transfer Learning for Vision-and-Language Tasks" (CVPR2022)
  ☆206Updated 2 years ago
• zengyan-97 / CCLM
  Cross-View Language Modeling: Towards Unified Cross-Lingual Cross-Modal Pre-training (ACL 2023))
  ☆91Updated 2 years ago
• zhjohnchan / awesome-vision-and-language-pretraining
  A curated list of vision-and-language pre-training (VLP). :-)
  ☆59Updated 3 years ago
• xu-shitong / diffusion-image-captioning
  implementation of paper https://arxiv.org/abs/2210.04559
  ☆55Updated 2 years ago
• MILVLG / rosita
  ROSITA: Enhancing Vision-and-Language Semantic Alignments via Cross- and Intra-modal Knowledge Integration
  ☆56Updated 2 years ago
• mshukor / TFood
  [CVPRW22] Official Implementation of T-Food: "Transformer Decoders with MultiModal Regularization for Cross-Modal Food Retrieval". Accept…
  ☆33Updated 3 years ago
• thunlp / CPT
  Colorful Prompt Tuning for Pre-trained Vision-Language Models
  ☆49Updated 2 years ago
• Yushi-Hu / PromptCap
  natual language guided image captioning
  ☆86Updated last year
• WangFei-2019 / Image-text-Retrieval
  ☆46Updated 3 years ago
• fawazsammani / nlxgpt
  NLX-GPT: A Model for Natural Language Explanations in Vision and Vision-Language Tasks, CVPR 2022 (Oral)
  ☆48Updated last year
• DavidHuji / CapDec
  CapDec: SOTA Zero Shot Image Captioning Using CLIP and GPT2, EMNLP 2022 (findings)
  ☆199Updated last year
• marslanm / Multimodality-Representation-Learning
  This repository provides a comprehensive collection of research papers focused on multimodal representation learning, all of which have b…
  ☆80Updated 3 months ago
• zengyan-97 / X2-VLM
  All-In-One VLM: Image + Video + Transfer to Other Languages / Domains (TPAMI 2023)
  ☆165Updated last year
• eric-ai-lab / CPL
  Official implementation of our EMNLP 2022 paper "CPL: Counterfactual Prompt Learning for Vision and Language Models"
  ☆34Updated 2 years ago
• joeyz0z / ConZIC
  Official implementation of "ConZIC: Controllable Zero-shot Image Captioning by Sampling-Based Polishing"
  ☆75Updated 2 years ago
• NeverMoreLCH / Awesome-VQA
  A reading list of papers about Visual Question Answering.
  ☆33Updated 3 years ago
• salesforce / ALPRO
  Align and Prompt: Video-and-Language Pre-training with Entity Prompts
  ☆188Updated 4 months ago
• guilk / KAT
  Research code for "KAT: A Knowledge Augmented Transformer for Vision-and-Language"
  ☆68Updated 3 years ago
• MichaelZhouwang / VLUE
  This repo contains codes and instructions for baselines in the VLUE benchmark.
  ☆41Updated 3 years ago
• microsoft / PICa
  An Empirical Study of GPT-3 for Few-Shot Knowledge-Based VQA, AAAI 2022 (Oral)
  ☆85Updated 3 years ago
• buxiangzhiren / DDCap
  ☆84Updated 2 years ago
• boheumd / A2Summ
  The official implementation of 'Align and Attend: Multimodal Summarization with Dual Contrastive Losses' (CVPR 2023)
  ☆79Updated 2 years ago
• bighuang624 / VoP
  [CVPR 2023] VoP: Text-Video Co-operative Prompt Tuning for Cross-Modal Retrieval
  ☆38Updated 2 years ago
• PLUM-Lab / MultiInstruct
  MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuning
  ☆135Updated 2 years ago
• sushizixin / CLIP4IDC
  CLIP4IDC: CLIP for Image Difference Captioning (AACL 2022)
  ☆34Updated 2 years ago
• yangbang18 / MultiCapCLIP
  (ACL'2023) MultiCapCLIP: Auto-Encoding Prompts for Zero-Shot Multilingual Visual Captioning
  ☆35Updated last year