Alternatives and similar repositories for CLIP-ViL

Users that are interested in CLIP-ViL are comparing it to the libraries listed below

• pzzhang / VinVL
  project page for VinVL
  ☆356Updated last year
• zdou0830 / METER
  METER: A Multimodal End-to-end TransformER Framework
  ☆374Updated 2 years ago
• facebookresearch / grid-feats-vqa
  Grid features pre-training code for visual question answering
  ☆269Updated 3 years ago
• microsoft / scene_graph_benchmark
  image scene graph generation benchmark
  ☆396Updated 2 years ago
• j-min / VL-T5
  PyTorch code for "Unifying Vision-and-Language Tasks via Text Generation" (ICML 2021)
  ☆371Updated last year
• MILVLG / bottom-up-attention.pytorch
  A PyTorch reimplementation of bottom-up-attention models
  ☆301Updated 3 years ago
• igorbrigadir / DownloadConceptualCaptions
  Reliably download millions of images efficiently
  ☆116Updated 4 years ago
• shilrley6 / Faster-R-CNN-with-model-pretrained-on-Visual-Genome
  Faster RCNN model in Pytorch version, pretrained on the Visual Genome with ResNet 101
  ☆237Updated 2 years ago
• ylsung / VL_adapter
  PyTorch code for "VL-Adapter: Parameter-Efficient Transfer Learning for Vision-and-Language Tasks" (CVPR2022)
  ☆205Updated 2 years ago
• jayleicn / ClipBERT
  [CVPR 2021 Best Student Paper Honorable Mention, Oral] Official PyTorch code for ClipBERT, an efficient framework for end-to-end learning…
  ☆722Updated last year
• rowanz / merlot
  MERLOT: Multimodal Neural Script Knowledge Models
  ☆224Updated 3 years ago
• zengyan-97 / X-VLM
  X-VLM: Multi-Grained Vision Language Pre-Training (ICML 2022)
  ☆479Updated 2 years ago
• salaniz / pycocoevalcap
  Python 3 support for the MS COCO caption evaluation tools
  ☆321Updated 11 months ago
• phellonchen / awesome-Vision-and-Language-Pre-training
  Recent Advances in Vision and Language Pre-training (VLP)
  ☆292Updated 2 years ago
• showlab / all-in-one
  [CVPR2023] All in One: Exploring Unified Video-Language Pre-training
  ☆283Updated 2 years ago
• uta-smile / TCL
  code for TCL: Vision-Language Pre-Training with Triple Contrastive Learning, CVPR 2022
  ☆264Updated 9 months ago
• salesforce / ALPRO
  Align and Prompt: Video-and-Language Pre-training with Entity Prompts
  ☆188Updated 2 months ago
• BryanPlummer / flickr30k_entities
  Flickr30K Entities Dataset
  ☆177Updated 6 years ago
• microsoft / UniVL
  An official implementation for " UniVL: A Unified Video and Language Pre-Training Model for Multimodal Understanding and Generation"
  ☆357Updated 11 months ago
• airsplay / py-bottom-up-attention
  PyTorch bottom-up attention with Detectron2
  ☆233Updated 3 years ago
• linjieli222 / HERO
  Research code for EMNLP 2020 paper "HERO: Hierarchical Encoder for Video+Language Omni-representation Pre-training"
  ☆233Updated 3 years ago
• vacancy / SceneGraphParser
  A python toolkit for parsing captions (in natural language) into scene graphs (as symbolic representations).
  ☆584Updated last year
• researchmm / soho
  [CVPR'21 Oral] Seeing Out of tHe bOx: End-to-End Pre-training for Vision-Language Representation Learning
  ☆208Updated 2 years ago
• MILVLG / openvqa
  A lightweight, scalable, and general framework for visual question answering research
  ☆325Updated 3 years ago
• antoyang / just-ask
  [ICCV 2021 Oral + TPAMI] Just Ask: Learning to Answer Questions from Millions of Narrated Videos
  ☆123Updated last year
• forence / Awesome-Visual-Captioning
  This repository focus on Image Captioning & Video Captioning & Seq-to-Seq Learning & NLP
  ☆412Updated 2 years ago
• jayleicn / singularity
  [ACL 2023] Official PyTorch code for Singularity model in "Revealing Single Frame Bias for Video-and-Language Learning"
  ☆135Updated 2 years ago
• davidnvq / grit
  GRIT: Faster and Better Image-captioning Transformer (ECCV 2022)
  ☆194Updated 2 years ago
• microsoft / SwinBERT
  Research code for CVPR 2022 paper "SwinBERT: End-to-End Transformers with Sparse Attention for Video Captioning"
  ☆240Updated 3 years ago
• zyang-ur / onestage_grounding
  A Fast and Accurate One-Stage Approach to Visual Grounding, ICCV 2019 (Oral)
  ☆147Updated 4 years ago