Alternatives and similar repositories for multimodal-transformers-movies

Users that are interested in multimodal-transformers-movies are comparing it to the libraries listed below

• akashe / Multimodal-action-recognition
  Code on selecting an action based on multimodal inputs. Here in this case inputs are voice and text.
  ☆73Updated 4 years ago
• affect2mm / emotion-timeseries
  ☆16Updated 4 years ago
• ufal / MLASK
  EACL 2023 paper "MLASK: Multimodal Summarization of Video-based News Articles"
  ☆12Updated last year
• sangho-vision / avbert
  ☆31Updated 4 years ago
• PALMJJ / Multimodal-short-video-classification
  Multimodal short video classification task, integrating video, image, audio and text modes for short video classification
  ☆19Updated 5 years ago
• Skyline-9 / Visionary-Vids
  Multi-modal transformer approach for natural language query based joint video summarization and highlight detection
  ☆16Updated last year
• ammesatyajit / VideoBERT
  Using VideoBERT to tackle video prediction
  ☆132Updated 4 years ago
• ninatu / everything_at_once
  Official implementation of "Everything at Once - Multi-modal Fusion Transformer for Video Retrieval." CVPR 2022
  ☆112Updated 3 years ago
• md-mohaiminul / ViS4mer
  ☆56Updated 3 years ago
• v-iashin / MDVC
  PyTorch implementation of Multi-modal Dense Video Captioning (CVPR 2020 Workshops)
  ☆145Updated 2 years ago
• yanbeic / CCL
  PyTorch Implementation on Paper [CVPR2021]Distilling Audio-Visual Knowledge by Compositional Contrastive Learning
  ☆89Updated 4 years ago
• boheumd / A2Summ
  The official implementation of 'Align and Attend: Multimodal Summarization with Dual Contrastive Losses' (CVPR 2023)
  ☆79Updated 2 years ago
• zinengtang / TVLT
  PyTorch code for “TVLT: Textless Vision-Language Transformer” (NeurIPS 2022 Oral)
  ☆126Updated 2 years ago
• nchucvml / STVT
  Video Summarization With Spatiotemporal Vision Transformer
  ☆21Updated 2 years ago
• pliang279 / HighMMT
  [TMLR 2022] High-Modality Multimodal Transformer
  ☆117Updated 10 months ago
• codezakh / exploiting-BERT-thru-translation
  [ACM MM 2021 Oral] Exploiting BERT For Multimodal Target Sentiment Classification Through Input Space Translation"
  ☆40Updated 4 years ago
• MichiganNLP / In-the-wild-QA
  In-the-wild Question Answering
  ☆15Updated 2 years ago
• cardinalblue / clip-models-for-distillation
  ☆18Updated 2 years ago
• m-bain / CondensedMovies-chall
  Condensed Movies Challenge 2021
  ☆19Updated 3 years ago
• catalina17 / XFlow
  Generalized cross-modal NNs; new audiovisual benchmark (IEEE TNNLS 2019)
  ☆28Updated 5 years ago
• fcakyon / video-transformers
  Easiest way of fine-tuning HuggingFace video classification models
  ☆145Updated 2 years ago
• jylins / videoxum
  [TMM 2023] VideoXum: Cross-modal Visual and Textural Summarization of Videos
  ☆49Updated last year
• IntelLabs / GraVi-T
  Graph learning framework for long-term video understanding
  ☆66Updated 2 months ago
• facebookresearch / vsc2022
  Code for the Video Similarity Challenge.
  ☆80Updated last year
• miguelsvasco / gmc
  Official Implementation of "Geometric Multimodal Contrastive Representation Learning" (https://arxiv.org/abs/2202.03390)
  ☆28Updated 8 months ago
• ppapalampidi / GraphTP
  Source code for the AAAI 2021 paper "Movie Summarization via Sparse Graph Construction"
  ☆32Updated 4 years ago
• VarnithChordia / Multimodal_Classification_Co_Attention
  Multimodal classification solution for the SIGIR eCOM using Co-attention and transformer language models
  ☆19Updated 5 years ago
• Jielin-Qiu / MMSum_model
  [CVPR 2024] MMSum: A Dataset for Multimodal Summarization and Thumbnail Generation of Videos
  ☆34Updated 7 months ago
• thuiar / Cross-Modal-BERT
  CM-BERT: Cross-Modal BERT for Text-Audio Sentiment Analysis（MM2020）
  ☆114Updated 4 years ago
• e-apostolidis / PGL-SUM
  A PyTorch Implementation of PGL-SUM from "Combining Global and Local Attention with Positional Encoding for Video Summarization" (IEEE IS…
  ☆90Updated 2 years ago