Alternatives and similar repositories for merlot:

Users that are interested in merlot are comparing it to the libraries listed below

• rowanz / merlot_reserve
  Code release for "MERLOT Reserve: Neural Script Knowledge through Vision and Language and Sound"
  ☆139Updated 2 years ago
• MikeWangWZHL / VidIL
  Pytorch code for Language Models with Image Descriptors are Strong Few-Shot Video-Language Learners
  ☆114Updated 2 years ago
• j-min / VL-T5
  PyTorch code for "Unifying Vision-and-Language Tasks via Text Generation" (ICML 2021)
  ☆368Updated last year
• jayleicn / singularity
  [ACL 2023] Official PyTorch code for Singularity model in "Revealing Single Frame Bias for Video-and-Language Learning"
  ☆132Updated last year
• igorbrigadir / DownloadConceptualCaptions
  Reliably download millions of images efficiently
  ☆113Updated 4 years ago
• salesforce / VD-BERT
  ☆44Updated 2 years ago
• antoine77340 / S3D_HowTo100M
  S3D Text-Video model trained on HowTo100M using MIL-NCE
  ☆194Updated 4 years ago
• e-bug / volta
  [TACL 2021] Code and data for the framework in "Multimodal Pretraining Unmasked: A Meta-Analysis and a Unified Framework of Vision-and-La…
  ☆114Updated 3 years ago
• jimmy646 / violin
  Data and code for CVPR 2020 paper: "VIOLIN: A Large-Scale Dataset for Video-and-Language Inference"
  ☆160Updated 4 years ago
• antoyang / just-ask
  [ICCV 2021 Oral + TPAMI] Just Ask: Learning to Answer Questions from Millions of Narrated Videos
  ☆120Updated last year
• TheShadow29 / VidSitu
  [CVPR21] Visual Semantic Role Labeling for Video Understanding (https://arxiv.org/abs/2104.00990)
  ☆59Updated 3 years ago
• jayleicn / recurrent-transformer
  [ACL 2020] PyTorch code for MART: Memory-Augmented Recurrent Transformer for Coherent Video Paragraph Captioning
  ☆169Updated 4 years ago
• airsplay / vokenization
  PyTorch code for EMNLP 2020 Paper "Vokenization: Improving Language Understanding with Visual Supervision"
  ☆187Updated 4 years ago
• google-research-datasets / Crisscrossed-Captions
  Extended Intramodal and Intermodal Semantic Similarity Judgments for MS-COCO
  ☆51Updated 4 years ago
• jamespark3922 / visual-comet
  VisualCOMET: Reasoning about the Dynamic Context of a Still Image
  ☆85Updated last year
• necla-ml / SNLI-VE
  Dataset and starting code for visual entailment dataset
  ☆109Updated 2 years ago
• ylsung / VL_adapter
  PyTorch code for "VL-Adapter: Parameter-Efficient Transfer Learning for Vision-and-Language Tasks" (CVPR2022)
  ☆204Updated 2 years ago
• pzzhang / VinVL
  project page for VinVL
  ☆353Updated last year
• jayleicn / VideoLanguageFuturePred
  [EMNLP 2020] What is More Likely to Happen Next? Video-and-Language Future Event Prediction
  ☆48Updated 2 years ago
• zhegan27 / VILLA
  Research Code for NeurIPS 2020 Spotlight paper "Large-Scale Adversarial Training for Vision-and-Language Representation Learning": UNITER…
  ☆119Updated 4 years ago
• salesforce / ALPRO
  Align and Prompt: Video-and-Language Pre-training with Entity Prompts
  ☆185Updated 2 years ago
• allenai / sherlock
  Code, data, models for the Sherlock corpus
  ☆57Updated 2 years ago
• vmurahari3 / visdial-bert
  Implementation for "Large-scale Pretraining for Visual Dialog" https://arxiv.org/abs/1912.02379
  ☆96Updated 4 years ago
• VALUE-Leaderboard / StarterCode
  Starter Code for VALUE benchmark
  ☆80Updated 2 years ago
• antoine77340 / howto100m
  Code for the HowTo100M paper
  ☆262Updated 5 years ago
• clip-vil / CLIP-ViL
  [ICLR 2022] code for "How Much Can CLIP Benefit Vision-and-Language Tasks?" https://arxiv.org/abs/2107.06383
  ☆411Updated 2 years ago
• medhini / clip_it
  CLIP-It! Language-Guided Video Summarization
  ☆73Updated 3 years ago
• yxuansu / MAGIC
  Language Models Can See: Plugging Visual Controls in Text Generation
  ☆256Updated 2 years ago
• HendrikStrobelt / miniClip
  ☆47Updated 4 years ago
• jayleicn / TVQAplus
  [ACL 2020] PyTorch code for TVQA+: Spatio-Temporal Grounding for Video Question Answering
  ☆128Updated 2 years ago