Alternatives and similar repositories for awesome-vision-and-language-pretraining

Users that are interested in awesome-vision-and-language-pretraining are comparing it to the libraries listed below

• StanfordMIMI / villa
  [ICCV 2023] ViLLA: Fine-grained vision-language representation learning from real-world data
  ☆46Updated 2 years ago
• marslanm / Multimodality-Representation-Learning
  This repository provides a comprehensive collection of research papers focused on multimodal representation learning, all of which have b…
  ☆81Updated 5 months ago
• ChenDelong1999 / polite-flamingo
  🦩 Visual Instruction Tuning with Polite Flamingo - training multi-modal LLMs to be both clever and polite! (AAAI-24 Oral)
  ☆64Updated last year
• xu-shitong / diffusion-image-captioning
  implementation of paper https://arxiv.org/abs/2210.04559
  ☆56Updated 3 years ago
• MichaelZhouwang / VLUE
  This repo contains codes and instructions for baselines in the VLUE benchmark.
  ☆41Updated 3 years ago
• thunlp / CPT
  Colorful Prompt Tuning for Pre-trained Vision-Language Models
  ☆49Updated 3 years ago
• zengyan-97 / X2-VLM
  All-In-One VLM: Image + Video + Transfer to Other Languages / Domains (TPAMI 2023)
  ☆166Updated last year
• YulongBonjour / SimVLM
  SimVLM ---SIMPLE VISUAL LANGUAGE MODEL PRETRAINING WITH WEAK SUPERVISION
  ☆36Updated 3 years ago
• sergiotasconmorales / consistency_vqa
  Repository of paper Consistency-preserving Visual Question Answering in Medical Imaging (MICCAI2022)
  ☆24Updated 2 years ago
• Yuco-Z / Awesome-Multi-Modal-Dialog
  [Paperlist] Awesome paper list of multimodal dialog, including methods, datasets and metrics
  ☆37Updated 10 months ago
• NeverMoreLCH / Awesome-VQA
  A reading list of papers about Visual Question Answering.
  ☆35Updated 3 years ago
• amazon-science / mix-generation
  MixGen: A New Multi-Modal Data Augmentation
  ☆126Updated 2 years ago
• kugwzk / DiDE
  Code for EMNLP 2022 paper “Distilled Dual-Encoder Model for Vision-Language Understanding”
  ☆31Updated 2 years ago
• shizhediao / DaVinci
  Source code for the paper "Prefix Language Models are Unified Modal Learners"
  ☆43Updated 2 years ago
• PLUM-Lab / MultiInstruct
  MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuning
  ☆134Updated 2 years ago
• yangbang18 / MultiCapCLIP
  (ACL'2023) MultiCapCLIP: Auto-Encoding Prompts for Zero-Shot Multilingual Visual Captioning
  ☆36Updated last year
• microsoft / FIBER
  Coarse-to-Fine Vision-Language Pre-training with Fusion in the Backbone
  ☆130Updated 2 years ago
• buxiangzhiren / DDCap
  ☆85Updated 2 years ago
• LijieFan / LaCLIP
  [NeurIPS 2023] Text data, code and pre-trained models for paper "Improving CLIP Training with Language Rewrites"
  ☆287Updated last year
• jeykigung / HiCLIP
  ☆30Updated 2 years ago
• ilkerkesen / frozen
  A PyTorch implementation of Multimodal Few-Shot Learning with Frozen Language Models with OPT.
  ☆43Updated 3 years ago
• limanling / clip-event
  ☆106Updated 3 years ago
• codezakh / LilT
  [ICLR 23] Contrastive Aligned of Vision to Language Through Parameter-Efficient Transfer Learning
  ☆40Updated 2 years ago
• Hxyou / IdealGPT
  Official Code of IdealGPT
  ☆35Updated 2 years ago
• deepaknlp / MedVidQACL
  Implementation of the Benchmark Approaches for Medical Instructional Video Classification (MedVidCL) and Medical Video Question Answering…
  ☆30Updated 2 years ago
• goel-shashank / CyCLIP
  ☆120Updated 2 years ago
• xiangyu-mm / EasyGen
  The official code for paper "EasyGen: Easing Multimodal Generation with a Bidirectional Conditional Diffusion Model and LLMs"
  ☆73Updated last year
• sIncerass / MVLPT
  code for "Multitask Vision-Language Prompt Tuning" https://arxiv.org/abs/2211.11720
  ☆57Updated last year
• ylsung / VL_adapter
  PyTorch code for "VL-Adapter: Parameter-Efficient Transfer Learning for Vision-and-Language Tasks" (CVPR2022)
  ☆207Updated 2 years ago
• zh-plus / Awesome-VLP-and-Efficient-Transformer
  Vision-Language Pretraining & Efficient Transformer Papers.
  ☆15Updated 3 years ago