Alternatives and similar repositories for SimVLM

Users that are interested in SimVLM are comparing it to the libraries listed below

• ilkerkesen / frozen
  A PyTorch implementation of Multimodal Few-Shot Learning with Frozen Language Models with OPT.
  ☆43Updated 2 years ago
• amazon-science / mix-generation
  MixGen: A New Multi-Modal Data Augmentation
  ☆124Updated 2 years ago
• ylsung / VL_adapter
  PyTorch code for "VL-Adapter: Parameter-Efficient Transfer Learning for Vision-and-Language Tasks" (CVPR2022)
  ☆205Updated 2 years ago
• WangFei-2019 / Image-text-Retrieval
  ☆45Updated 2 years ago
• uta-smile / TCL
  code for TCL: Vision-Language Pre-Training with Triple Contrastive Learning, CVPR 2022
  ☆264Updated 9 months ago
• limanling / clip-event
  ☆104Updated 3 years ago
• Yushi-Hu / PromptCap
  natual language guided image captioning
  ☆84Updated last year
• microsoft / PICa
  An Empirical Study of GPT-3 for Few-Shot Knowledge-Based VQA, AAAI 2022 (Oral)
  ☆85Updated 3 years ago
• buxiangzhiren / DDCap
  ☆84Updated 2 years ago
• zengyan-97 / CCLM
  Cross-View Language Modeling: Towards Unified Cross-Lingual Cross-Modal Pre-training (ACL 2023))
  ☆90Updated 2 years ago
• fawazsammani / nlxgpt
  NLX-GPT: A Model for Natural Language Explanations in Vision and Vision-Language Tasks, CVPR 2022 (Oral)
  ☆48Updated last year
• rentainhe / TRAR-VQA
  [ICCV 2021] Official implementation of the paper "TRAR: Routing the Attention Spans in Transformers for Visual Question Answering"
  ☆66Updated 3 years ago
• zhjohnchan / awesome-vision-and-language-pretraining
  A curated list of vision-and-language pre-training (VLP). :-)
  ☆59Updated 3 years ago
• joeyz0z / ConZIC
  Official implementation of "ConZIC: Controllable Zero-shot Image Captioning by Sampling-Based Polishing"
  ☆73Updated last year
• thunlp / PEVL
  Source code for EMNLP 2022 paper “PEVL: Position-enhanced Pre-training and Prompt Tuning for Vision-language Models”
  ☆48Updated 2 years ago
• zengyan-97 / X2-VLM
  All-In-One VLM: Image + Video + Transfer to Other Languages / Domains (TPAMI 2023)
  ☆163Updated 10 months ago
• xu-shitong / diffusion-image-captioning
  implementation of paper https://arxiv.org/abs/2210.04559
  ☆54Updated 2 years ago
• naver-ai / pcme
  Official Pytorch implementation of "Probabilistic Cross-Modal Embedding" (CVPR 2021)
  ☆132Updated last year
• MILVLG / rosita
  ROSITA: Enhancing Vision-and-Language Semantic Alignments via Cross- and Intra-modal Knowledge Integration
  ☆56Updated 2 years ago
• davidnvq / grit
  GRIT: Faster and Better Image-captioning Transformer (ECCV 2022)
  ☆194Updated 2 years ago
• thunlp / CPT
  Colorful Prompt Tuning for Pre-trained Vision-Language Models
  ☆49Updated 2 years ago
• eric-ai-lab / CPL
  Official implementation of our EMNLP 2022 paper "CPL: Counterfactual Prompt Learning for Vision and Language Models"
  ☆34Updated 2 years ago
• jianjieluo / SCD-Net
  [CVPR23] A cascaded diffusion captioning model with a novel semantic-conditional diffusion process that upgrades conventional diffusion m…
  ☆64Updated last year
• PLUM-Lab / MultiInstruct
  MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuning
  ☆135Updated 2 years ago
• DavidHuji / CapDec
  CapDec: SOTA Zero Shot Image Captioning Using CLIP and GPT2, EMNLP 2022 (findings)
  ☆197Updated last year
• sushizixin / CLIP4IDC
  CLIP4IDC: CLIP for Image Difference Captioning (AACL 2022)
  ☆34Updated 2 years ago
• salesforce / ALPRO
  Align and Prompt: Video-and-Language Pre-training with Entity Prompts
  ☆188Updated 2 months ago
• McGill-NLP / imagecode
  Code and data for ImageCoDe, a contextual vison-and-language benchmark
  ☆40Updated last year
• guilk / KAT
  Research code for "KAT: A Knowledge Augmented Transformer for Vision-and-Language"
  ☆65Updated 3 years ago
• MichaelZhouwang / VLUE
  This repo contains codes and instructions for baselines in the VLUE benchmark.
  ☆41Updated 3 years ago