Alternatives and similar repositories for localized-narratives

Users that are interested in localized-narratives are comparing it to the libraries listed below

• facebookresearch / connect-caption-and-trace
  A unified framework to jointly model images, text, and human attention traces.
  ☆79Updated 4 years ago
• allenai / gpv-1
  A task-agnostic vision-language architecture as a step towards General Purpose Vision
  ☆92Updated 4 years ago
• TheShadow29 / VidSitu
  [CVPR21] Visual Semantic Role Labeling for Video Understanding (https://arxiv.org/abs/2104.00990)
  ☆62Updated 4 years ago
• jimmy646 / violin
  Data and code for CVPR 2020 paper: "VIOLIN: A Large-Scale Dataset for Video-and-Language Inference"
  ☆162Updated 5 years ago
• easonnie / mlp-vil
  MLPs for Vision and Langauge Modeling (Coming Soon)
  ☆27Updated 3 years ago
• airsplay / vimpac
  ☆73Updated 3 years ago
• gsig / visual-grounding
  Project page for "Visual Grounding in Video for Unsupervised Word Translation" CVPR 2020
  ☆42Updated 5 years ago
• LuoweiZhou / YouCook2-Leaderboard
  A one-stop shop for YouCook2 info such as leaderboard and recent advances on (cooking) video retrieval and captioning.
  ☆40Updated 3 years ago
• rowanz / merlot
  MERLOT: Multimodal Neural Script Knowledge Models
  ☆225Updated 3 years ago
• medhini / clip_it
  CLIP-It! Language-Guided Video Summarization
  ☆75Updated 4 years ago
• VALUE-Leaderboard / DataRelease
  Data Release for VALUE Benchmark
  ☆30Updated 3 years ago
• intersun / LightningDOT
  source code and pre-trained/fine-tuned checkpoint for NAACL 2021 paper LightningDOT
  ☆72Updated 3 years ago
• BigRedT / vico
  Multi-sense word embeddings from visual co-occurrences
  ☆25Updated 6 years ago
• cvlab-columbia / globetrotter
  Code for the Globetrotter project
  ☆23Updated 3 years ago
• zinengtang / Perceiver_VL
  PyTorch code for "Perceiver-VL: Efficient Vision-and-Language Modeling with Iterative Latent Attention" (WACV 2023)
  ☆33Updated 2 years ago
• bearcatt / LaBERT
  A length-controllable and non-autoregressive image captioning model.
  ☆68Updated 4 years ago
• antoine77340 / RareAct
  RareAct: A video dataset of unusual interactions
  ☆33Updated 5 years ago
• zinengtang / VidLanKD
  Pytorch version of VidLanKD: Improving Language Understanding viaVideo-Distilled Knowledge Transfer (NeurIPS 2021))
  ☆56Updated 2 years ago
• redcaps-dataset / redcaps-downloader
  Command-line tool for downloading and extending the RedCaps dataset.
  ☆50Updated last year
• allenai / x-lxmert
  PyTorch code for EMNLP 2020 paper "X-LXMERT: Paint, Caption and Answer Questions with Multi-Modal Transformers"
  ☆50Updated 4 years ago
• allenai / swig
  Situation With Groundings (SWiG) dataset and Joint Situation Localizer (JSL)
  ☆69Updated 4 years ago
• lichengunc / pretrain-vl-data
  Pre-trained V+L Data Preparation
  ☆46Updated 5 years ago
• satwikkottur / clevr-dialog
  Repository to generate CLEVR-Dialog: A diagnostic dataset for Visual Dialog
  ☆49Updated 5 years ago
• LisaAnne / TemporalLanguageRelease
  ☆43Updated 4 years ago
• Deferf / CLIP_Video_Representation
  Use CLIP to represent video for Retrieval Task
  ☆70Updated 4 years ago
• antoyang / just-ask
  [ICCV 2021 Oral + TPAMI] Just Ask: Learning to Answer Questions from Millions of Narrated Videos
  ☆124Updated 2 years ago
• cvlab-columbia / expert
  Code for Learning to Learn Language from Narrated Video
  ☆33Updated 2 years ago
• jayleicn / TVQA
  [EMNLP 2018] PyTorch code for TVQA: Localized, Compositional Video Question Answering
  ☆181Updated 3 years ago
• zinengtang / DeCEMBERT
  Pytorch version of DeCEMBERT: Learning from Noisy Instructional Videos via Dense Captions and Entropy Minimization (NAACL 2021)
  ☆17Updated 2 years ago
• LuoweiZhou / densecap
  Dense video captioning in PyTorch
  ☆41Updated 6 years ago