Alternatives and similar repositories for CLIP-ViL

Users that are interested in CLIP-ViL are comparing it to the libraries listed below

• pzzhang / VinVL
  project page for VinVL
  ☆354Updated last year
• zdou0830 / METER
  METER: A Multimodal End-to-end TransformER Framework
  ☆369Updated 2 years ago
• phellonchen / awesome-Vision-and-Language-Pre-training
  Recent Advances in Vision and Language Pre-training (VLP)
  ☆292Updated last year
• microsoft / scene_graph_benchmark
  image scene graph generation benchmark
  ☆396Updated 2 years ago
• jayleicn / ClipBERT
  [CVPR 2021 Best Student Paper Honorable Mention, Oral] Official PyTorch code for ClipBERT, an efficient framework for end-to-end learning…
  ☆719Updated last year
• MILVLG / bottom-up-attention.pytorch
  A PyTorch reimplementation of bottom-up-attention models
  ☆301Updated 3 years ago
• researchmm / soho
  [CVPR'21 Oral] Seeing Out of tHe bOx: End-to-End Pre-training for Vision-Language Representation Learning
  ☆208Updated 2 years ago
• uta-smile / TCL
  code for TCL: Vision-Language Pre-Training with Triple Contrastive Learning, CVPR 2022
  ☆262Updated 7 months ago
• igorbrigadir / DownloadConceptualCaptions
  Reliably download millions of images efficiently
  ☆116Updated 4 years ago
• facebookresearch / grid-feats-vqa
  Grid features pre-training code for visual question answering
  ☆269Updated 3 years ago
• shilrley6 / Faster-R-CNN-with-model-pretrained-on-Visual-Genome
  Faster RCNN model in Pytorch version, pretrained on the Visual Genome with ResNet 101
  ☆237Updated 2 years ago
• ylsung / VL_adapter
  PyTorch code for "VL-Adapter: Parameter-Efficient Transfer Learning for Vision-and-Language Tasks" (CVPR2022)
  ☆206Updated 2 years ago
• DavidHuji / CapDec
  CapDec: SOTA Zero Shot Image Captioning Using CLIP and GPT2, EMNLP 2022 (findings)
  ☆196Updated last year
• microsoft / UniVL
  An official implementation for " UniVL: A Unified Video and Language Pre-Training Model for Multimodal Understanding and Generation"
  ☆354Updated 9 months ago
• showlab / all-in-one
  [CVPR2023] All in One: Exploring Unified Video-Language Pre-training
  ☆282Updated 2 years ago
• forence / Awesome-Visual-Captioning
  This repository focus on Image Captioning & Video Captioning & Seq-to-Seq Learning & NLP
  ☆413Updated 2 years ago
• BryanPlummer / flickr30k_entities
  Flickr30K Entities Dataset
  ☆173Updated 6 years ago
• j-min / VL-T5
  PyTorch code for "Unifying Vision-and-Language Tasks via Text Generation" (ICML 2021)
  ☆372Updated last year
• salesforce / ALPRO
  Align and Prompt: Video-and-Language Pre-training with Entity Prompts
  ☆187Updated 2 weeks ago
• Sense-GVT / DeCLIP
  Supervision Exists Everywhere: A Data Efficient Contrastive Language-Image Pre-training Paradigm
  ☆654Updated 2 years ago
• zengyan-97 / X-VLM
  X-VLM: Multi-Grained Vision Language Pre-Training (ICML 2022)
  ☆478Updated 2 years ago
• davidnvq / grit
  GRIT: Faster and Better Image-captioning Transformer (ECCV 2022)
  ☆191Updated 2 years ago
• ChenRocks / UNITER
  Research code for ECCV 2020 paper "UNITER: UNiversal Image-TExt Representation Learning"
  ☆792Updated 3 years ago
• LuoweiZhou / VLP
  Vision-Language Pre-training for Image Captioning and Question Answering
  ☆418Updated 3 years ago
• rowanz / merlot
  MERLOT: Multimodal Neural Script Knowledge Models
  ☆224Updated 3 years ago
• microsoft / UniCL
  [CVPR 2022] Official code for "Unified Contrastive Learning in Image-Text-Label Space"
  ☆398Updated last year
• airsplay / py-bottom-up-attention
  PyTorch bottom-up attention with Detectron2
  ☆233Updated 3 years ago
• linjieli222 / HERO
  Research code for EMNLP 2020 paper "HERO: Hierarchical Encoder for Video+Language Omni-representation Pre-training"
  ☆232Updated 3 years ago
• GT-RIPL / Xmodal-Ctx
  Official PyTorch implementation of our CVPR 2022 paper: Beyond a Pre-Trained Object Detector: Cross-Modal Textual and Visual Context for …
  ☆60Updated 2 years ago
• YoadTew / zero-shot-image-to-text
  Implementation of Zero-Shot Image-to-Text Generation for Visual-Semantic Arithmetic
  ☆275Updated 2 years ago