Alternatives and similar repositories for CLIP-ViL:

Users that are interested in CLIP-ViL are comparing it to the libraries listed below

• pzzhang / VinVL
  project page for VinVL
  ☆354Updated last year
• zdou0830 / METER
  METER: A Multimodal End-to-end TransformER Framework
  ☆369Updated 2 years ago
• microsoft / scene_graph_benchmark
  image scene graph generation benchmark
  ☆396Updated 2 years ago
• j-min / VL-T5
  PyTorch code for "Unifying Vision-and-Language Tasks via Text Generation" (ICML 2021)
  ☆370Updated last year
• phellonchen / awesome-Vision-and-Language-Pre-training
  Recent Advances in Vision and Language Pre-training (VLP)
  ☆292Updated last year
• MILVLG / bottom-up-attention.pytorch
  A PyTorch reimplementation of bottom-up-attention models
  ☆300Updated 3 years ago
• ylsung / VL_adapter
  PyTorch code for "VL-Adapter: Parameter-Efficient Transfer Learning for Vision-and-Language Tasks" (CVPR2022)
  ☆205Updated 2 years ago
• jayleicn / ClipBERT
  [CVPR 2021 Best Student Paper Honorable Mention, Oral] Official PyTorch code for ClipBERT, an efficient framework for end-to-end learning…
  ☆718Updated last year
• facebookresearch / grid-feats-vqa
  Grid features pre-training code for visual question answering
  ☆269Updated 3 years ago
• shilrley6 / Faster-R-CNN-with-model-pretrained-on-Visual-Genome
  Faster RCNN model in Pytorch version, pretrained on the Visual Genome with ResNet 101
  ☆237Updated 2 years ago
• BryanPlummer / flickr30k_entities
  Flickr30K Entities Dataset
  ☆171Updated 6 years ago
• rowanz / merlot
  MERLOT: Multimodal Neural Script Knowledge Models
  ☆223Updated 3 years ago
• forence / Awesome-Visual-Captioning
  This repository focus on Image Captioning & Video Captioning & Seq-to-Seq Learning & NLP
  ☆413Updated 2 years ago
• davidnvq / grit
  GRIT: Faster and Better Image-captioning Transformer (ECCV 2022)
  ☆190Updated last year
• uta-smile / TCL
  code for TCL: Vision-Language Pre-Training with Triple Contrastive Learning, CVPR 2022
  ☆261Updated 6 months ago
• zengyan-97 / X-VLM
  X-VLM: Multi-Grained Vision Language Pre-Training (ICML 2022)
  ☆478Updated 2 years ago
• igorbrigadir / DownloadConceptualCaptions
  Reliably download millions of images efficiently
  ☆115Updated 4 years ago
• Sense-GVT / DeCLIP
  Supervision Exists Everywhere: A Data Efficient Contrastive Language-Image Pre-training Paradigm
  ☆651Updated 2 years ago
• salesforce / ALPRO
  Align and Prompt: Video-and-Language Pre-training with Entity Prompts
  ☆187Updated 2 years ago
• DavidHuji / CapDec
  CapDec: SOTA Zero Shot Image Captioning Using CLIP and GPT2, EMNLP 2022 (findings)
  ☆195Updated last year
• researchmm / soho
  [CVPR'21 Oral] Seeing Out of tHe bOx: End-to-End Pre-training for Vision-Language Representation Learning
  ☆208Updated 2 years ago
• microsoft / UniCL
  [CVPR 2022] Official code for "Unified Contrastive Learning in Image-Text-Label Space"
  ☆396Updated last year
• google-research-datasets / conceptual-12m
  Conceptual 12M is a dataset containing (image-URL, caption) pairs collected for vision-and-language pre-training.
  ☆388Updated 2 years ago
• LuoweiZhou / VLP
  Vision-Language Pre-training for Image Captioning and Question Answering
  ☆417Updated 3 years ago
• showlab / all-in-one
  [CVPR2023] All in One: Exploring Unified Video-Language Pre-training
  ☆282Updated 2 years ago
• ashkamath / mdetr
  ☆997Updated 2 years ago
• microsoft / UniVL
  An official implementation for " UniVL: A Unified Video and Language Pre-Training Model for Multimodal Understanding and Generation"
  ☆351Updated 9 months ago
• MILVLG / openvqa
  A lightweight, scalable, and general framework for visual question answering research
  ☆322Updated 3 years ago
• salaniz / pycocoevalcap
  Python 3 support for the MS COCO caption evaluation tools
  ☆317Updated 8 months ago
• microsoft / SwinBERT
  Research code for CVPR 2022 paper "SwinBERT: End-to-End Transformers with Sparse Attention for Video Captioning"
  ☆238Updated 2 years ago