Alternatives and similar repositories for merlot_reserve

Users that are interested in merlot_reserve are comparing it to the libraries listed below

• rowanz / merlot

  View on GitHub
  MERLOT: Multimodal Neural Script Knowledge Models
  ☆225Mar 15, 2022Updated 3 years ago
• samuelyu2002 / PACS

  View on GitHub
  Code and dataset release for "PACS: A Dataset for Physical Audiovisual CommonSense Reasoning" (ECCV 2022)
  ☆17Dec 20, 2022Updated 3 years ago
• zinengtang / Perceiver_VL

  View on GitHub
  PyTorch code for "Perceiver-VL: Efficient Vision-and-Language Modeling with Iterative Latent Attention" (WACV 2023)
  ☆33Feb 5, 2023Updated 3 years ago
• VALUE-Leaderboard / DataRelease

  View on GitHub
  Data Release for VALUE Benchmark
  ☆30Feb 16, 2022Updated 4 years ago
• MikeWangWZHL / VidIL

  View on GitHub
  Pytorch code for Language Models with Image Descriptors are Strong Few-Shot Video-Language Learners
  ☆116Sep 15, 2022Updated 3 years ago
• jayleicn / singularity

  View on GitHub
  [ACL 2023] Official PyTorch code for Singularity model in "Revealing Single Frame Bias for Video-and-Language Learning"
  ☆136May 5, 2023Updated 2 years ago
• zinengtang / DeCEMBERT

  View on GitHub
  Pytorch version of DeCEMBERT: Learning from Noisy Instructional Videos via Dense Captions and Entropy Minimization (NAACL 2021)
  ☆17Jan 12, 2023Updated 3 years ago
• showlab / all-in-one

  View on GitHub
  [CVPR2023] All in One: Exploring Unified Video-Language Pre-training
  ☆281Mar 25, 2023Updated 2 years ago
• tsujuifu / pytorch_violet

  View on GitHub
  A PyTorch implementation of VIOLET
  ☆140Dec 17, 2023Updated 2 years ago
• zinengtang / TVLT

  View on GitHub
  PyTorch code for “TVLT: Textless Vision-Language Transformer” (NeurIPS 2022 Oral)
  ☆124Feb 24, 2023Updated 2 years ago
• hyounghk / VideoQADenseCapFrameGate-ACL2020

  View on GitHub
  Code for ACL 2020 paper "Dense-Caption Matching and Frame-Selection Gating for Temporal Localization in VideoQA." Hyounghun Kim, Zineng T…
  ☆34May 14, 2020Updated 5 years ago
• VALUE-Leaderboard / StarterCode

  View on GitHub
  Starter Code for VALUE benchmark
  ☆80Aug 23, 2022Updated 3 years ago
• dialogtekgeek / AVSD-DSTC10_Official

  View on GitHub
  Audio Visual Scene-Aware Dialog (AVSD) Challenge at the 10th Dialog System Technology Challenge (DSTC)
  ☆27Aug 19, 2022Updated 3 years ago
• mlfoundations / patching

  View on GitHub
  Patching open-vocabulary models by interpolating weights
  ☆91Sep 28, 2023Updated 2 years ago
• ylsung / VL_adapter

  View on GitHub
  PyTorch code for "VL-Adapter: Parameter-Efficient Transfer Learning for Vision-and-Language Tasks" (CVPR2022)
  ☆209Dec 18, 2022Updated 3 years ago
• YapengTian / AVVP-ECCV20

  View on GitHub
  Unified Multisensory Perception: Weakly-Supervised Audio-Visual Video Parsing, ECCV, 2020. (Spotlight)
  ☆89Jul 25, 2024Updated last year
• airsplay / vimpac

  View on GitHub
  ☆73Jun 3, 2022Updated 3 years ago
• j-min / VL-T5

  View on GitHub
  PyTorch code for "Unifying Vision-and-Language Tasks via Text Generation" (ICML 2021)
  ☆374Jul 29, 2023Updated 2 years ago
• salesforce / ALPRO

  View on GitHub
  Align and Prompt: Video-and-Language Pre-training with Entity Prompts
  ☆188May 1, 2025Updated 9 months ago
• yonatanbitton / data_efficient_masked_language_modeling_for_vision_and_language

  View on GitHub
  Repository for the paper "Data Efficient Masked Language Modeling for Vision and Language".
  ☆18Sep 17, 2021Updated 4 years ago
• CeeZh / SILVR

  View on GitHub
  Official Implementation for "SiLVR : A Simple Language-based Video Reasoning Framework"
  ☆19Jan 18, 2026Updated 3 weeks ago
• GenjiB / ECLIPSE

  View on GitHub
  ☆34Mar 10, 2023Updated 2 years ago
• jimmy646 / violin

  View on GitHub
  Data and code for CVPR 2020 paper: "VIOLIN: A Large-Scale Dataset for Video-and-Language Inference"
  ☆161Apr 29, 2020Updated 5 years ago
• m-bain / frozen-in-time

  View on GitHub
  Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrieval [ICCV'21]
  ☆380May 19, 2022Updated 3 years ago
• facebookresearch / SIMAT

  View on GitHub
  codebase for the SIMAT dataset and evaluation
  ☆38Feb 16, 2022Updated 3 years ago
• facebookresearch / omnivore

  View on GitHub
  Omnivore: A Single Model for Many Visual Modalities
  ☆571Nov 12, 2022Updated 3 years ago
• facebookresearch / DVDialogues

  View on GitHub
  Code for DVD A Diagnostic Dataset for Multi-step Reasoning in Video Grounded Dialogue
  ☆14Oct 12, 2021Updated 4 years ago
• ych133 / How2R-and-How2QA

  View on GitHub
  A video retrieval dataset How2R and a video QA dataset How2QA
  ☆24Oct 15, 2020Updated 5 years ago
• antoyang / just-ask

  View on GitHub
  [ICCV 2021 Oral + TPAMI] Just Ask: Learning to Answer Questions from Millions of Narrated Videos
  ☆126Sep 29, 2023Updated 2 years ago
• antoine77340 / S3D_HowTo100M

  View on GitHub
  S3D Text-Video model trained on HowTo100M using MIL-NCE
  ☆200Jul 3, 2020Updated 5 years ago
• antoine77340 / MIL-NCE_HowTo100M

  View on GitHub
  PyTorch GPU distributed training code for MIL-NCE HowTo100M
  ☆219Jul 5, 2022Updated 3 years ago
• klauscc / VindLU

  View on GitHub
  ☆110Dec 23, 2022Updated 3 years ago
• Sy-Zhang / MMC-PCFG

  View on GitHub
  Video-aided Unsupervised Grammar Induction, NAACL‘21 [best long paper]
  ☆40Oct 27, 2022Updated 3 years ago
• rowanz / piglet

  View on GitHub
  PIGLeT: Language Grounding Through Neuro-Symbolic Interaction in a 3D World [ACL 2021]
  ☆56Oct 29, 2021Updated 4 years ago
• bpiyush / TestOfTime

  View on GitHub
  Official code for our CVPR 2023 paper: Test of Time: Instilling Video-Language Models with a Sense of Time
  ☆46Jun 11, 2024Updated last year
• antoine77340 / howto100m

  View on GitHub
  Code for the HowTo100M paper
  ☆293Mar 10, 2020Updated 5 years ago
• kakaobrain / bassl

  View on GitHub
  ☆138Jan 3, 2024Updated 2 years ago
• microsoft / XPretrain

  View on GitHub
  Multi-modality pre-training
  ☆509May 8, 2024Updated last year
• jayleicn / mTVRetrieval

  View on GitHub
  [ACL 2021] mTVR: Multilingual Video Moment Retrieval
  ☆27Aug 20, 2022Updated 3 years ago