google / localized-narratives

Related projects: ⓘ

• facebookresearch / connect-caption-and-trace
  A unified framework to jointly model images, text, and human attention traces.
  ☆78Updated 3 years ago
• TheShadow29 / VidSitu
  [CVPR21] Visual Semantic Role Labeling for Video Understanding (https://arxiv.org/abs/2104.00990)
  ☆57Updated 3 years ago
• LuoweiZhou / YouCook2-Leaderboard
  A one-stop shop for YouCook2 info such as leaderboard and recent advances on (cooking) video retrieval and captioning.
  ☆37Updated 2 years ago
• jimmy646 / violin
  Data and code for CVPR 2020 paper: "VIOLIN: A Large-Scale Dataset for Video-and-Language Inference"
  ☆158Updated 4 years ago
• antoine77340 / RareAct
  RareAct: A video dataset of unusual interactions
  ☆32Updated 4 years ago
• BigRedT / vico
  Multi-sense word embeddings from visual co-occurrences
  ☆25Updated 5 years ago
• facebookresearch / video-distant-supervision
  This is an official pytorch implementation of Learning To Recognize Procedural Activities with Distant Supervision. In this repository, w…
  ☆39Updated last year
• facebookresearch / GDT
  We present a framework for training multi-modal deep learning models on unlabelled video data by forcing the network to learn invariances…
  ☆44Updated 3 years ago
• allenai / gpv-1
  A task-agnostic vision-language architecture as a step towards General Purpose Vision
  ☆92Updated 3 years ago
• airsplay / vimpac
  ☆74Updated 2 years ago
• VALUE-Leaderboard / DataRelease
  Data Release for VALUE Benchmark
  ☆32Updated 2 years ago
• cvlab-columbia / globetrotter
  Code for the Globetrotter project
  ☆23Updated 2 years ago
• medhini / clip_it
  CLIP-It! Language-Guided Video Summarization
  ☆72Updated 3 years ago
• google-deepmind / dmvr
  ☆66Updated last year
• facebookresearch / EgoCom-Dataset
  EgoCom: A Multi-person Multi-modal Egocentric Communications Dataset
  ☆52Updated 3 years ago
• Tushar-N / attributes-as-operators
  Attribute-Object Visual Composition using Attributes as Operators
  ☆64Updated last year
• zinengtang / Perceiver_VL
  PyTorch code for "Perceiver-VL: Efficient Vision-and-Language Modeling with Iterative Latent Attention" (WACV 2023)
  ☆32Updated last year
• IntelLabs / VL-InterpreT
  Visual Language Transformer Interpreter - An interactive visualization tool for interpreting vision-language transformers
  ☆85Updated last year
• gsig / visual-grounding
  Project page for "Visual Grounding in Video for Unsupervised Word Translation" CVPR 2020
  ☆42Updated 4 years ago
• redcaps-dataset / redcaps-downloader
  Command-line tool for downloading and extending the RedCaps dataset.
  ☆45Updated 9 months ago
• antoyang / just-ask
  [ICCV 2021 Oral + TPAMI] Just Ask: Learning to Answer Questions from Millions of Narrated Videos
  ☆117Updated 11 months ago
• LuoweiZhou / densecap
  Dense video captioning in PyTorch
  ☆41Updated 5 years ago
• allenai / x-lxmert
  PyTorch code for EMNLP 2020 paper "X-LXMERT: Paint, Caption and Answer Questions with Multi-Modal Transformers"
  ☆50Updated 3 years ago
• google-research-datasets / videoCC-data
  VideoCC is a dataset containing (video-URL, caption) pairs for training video-text machine learning models. It is created using an automa…
  ☆76Updated last year
• hassanhub / MultiGrounding
  This is the repo for Multi-level textual grounding
  ☆33Updated 4 years ago
• j-min / DallEval
  DALL-Eval: Probing the Reasoning Skills and Social Biases of Text-to-Image Generation Models (ICCV 2023)
  ☆136Updated 9 months ago
• adobe-research / vaw_dataset
  This repository provides data for the VAW dataset as described in the CVPR 2021 paper titled "Learning to Predict Visual Attributes in th…
  ☆61Updated 2 years ago
• bearcatt / LaBERT
  A length-controllable and non-autoregressive image captioning model.
  ☆66Updated 3 years ago
• HendrikStrobelt / miniClip
  ☆47Updated 3 years ago
• Deferf / CLIP_Video_Representation
  Use CLIP to represent video for Retrieval Task
  ☆67Updated 3 years ago