Alternatives and similar repositories for localized-narratives

Users that are interested in localized-narratives are comparing it to the libraries listed below

• facebookresearch / connect-caption-and-trace
  A unified framework to jointly model images, text, and human attention traces.
  ☆79Updated 4 years ago
• allenai / gpv-1
  A task-agnostic vision-language architecture as a step towards General Purpose Vision
  ☆92Updated 4 years ago
• jimmy646 / violin
  Data and code for CVPR 2020 paper: "VIOLIN: A Large-Scale Dataset for Video-and-Language Inference"
  ☆162Updated 5 years ago
• gsig / visual-grounding
  Project page for "Visual Grounding in Video for Unsupervised Word Translation" CVPR 2020
  ☆43Updated 5 years ago
• medhini / clip_it
  CLIP-It! Language-Guided Video Summarization
  ☆75Updated 4 years ago
• airsplay / vimpac
  ☆73Updated 3 years ago
• intersun / LightningDOT
  source code and pre-trained/fine-tuned checkpoint for NAACL 2021 paper LightningDOT
  ☆72Updated 3 years ago
• easonnie / mlp-vil
  MLPs for Vision and Langauge Modeling (Coming Soon)
  ☆27Updated 4 years ago
• redcaps-dataset / redcaps-downloader
  Command-line tool for downloading and extending the RedCaps dataset.
  ☆50Updated 2 years ago
• cvlab-columbia / globetrotter
  Code for the Globetrotter project
  ☆23Updated 3 years ago
• rowanz / merlot
  MERLOT: Multimodal Neural Script Knowledge Models
  ☆225Updated 3 years ago
• allenai / swig
  Situation With Groundings (SWiG) dataset and Joint Situation Localizer (JSL)
  ☆69Updated 4 years ago
• TheShadow29 / VidSitu
  [CVPR21] Visual Semantic Role Labeling for Video Understanding (https://arxiv.org/abs/2104.00990)
  ☆61Updated 4 years ago
• BigRedT / vico
  Multi-sense word embeddings from visual co-occurrences
  ☆25Updated 6 years ago
• facebookresearch / GDT
  We present a framework for training multi-modal deep learning models on unlabelled video data by forcing the network to learn invariances…
  ☆47Updated 4 years ago
• antoine77340 / RareAct
  RareAct: A video dataset of unusual interactions
  ☆33Updated 5 years ago
• zinengtang / VidLanKD
  Pytorch version of VidLanKD: Improving Language Understanding viaVideo-Distilled Knowledge Transfer (NeurIPS 2021))
  ☆56Updated 2 years ago
• VALUE-Leaderboard / DataRelease
  Data Release for VALUE Benchmark
  ☆30Updated 3 years ago
• zinengtang / Perceiver_VL
  PyTorch code for "Perceiver-VL: Efficient Vision-and-Language Modeling with Iterative Latent Attention" (WACV 2023)
  ☆33Updated 2 years ago
• hassanhub / MultiGrounding
  This is the repo for Multi-level textual grounding
  ☆34Updated 5 years ago
• LuoweiZhou / YouCook2-Leaderboard
  A one-stop shop for YouCook2 info such as leaderboard and recent advances on (cooking) video retrieval and captioning.
  ☆41Updated 3 years ago
• guilk / VLC
  Research code for "Training Vision-Language Transformers from Captions Alone"
  ☆33Updated 3 years ago
• lichengunc / pretrain-vl-data
  Pre-trained V+L Data Preparation
  ☆46Updated 5 years ago
• jayleicn / TVQA
  [EMNLP 2018] PyTorch code for TVQA: Localized, Compositional Video Question Answering
  ☆181Updated 3 years ago
• j-min / DallEval
  DALL-Eval: Probing the Reasoning Skills and Social Biases of Text-to-Image Generation Models (ICCV 2023)
  ☆143Updated 7 months ago
• cvlab-columbia / expert
  Code for Learning to Learn Language from Narrated Video
  ☆33Updated 2 years ago
• allenai / gpv2
  ☆32Updated 3 years ago
• satwikkottur / clevr-dialog
  Repository to generate CLEVR-Dialog: A diagnostic dataset for Visual Dialog
  ☆49Updated 5 years ago
• LuoweiZhou / densecap
  Dense video captioning in PyTorch
  ☆41Updated 6 years ago
• Deferf / CLIP_Video_Representation
  Use CLIP to represent video for Retrieval Task
  ☆70Updated 4 years ago