Alternatives and similar repositories for Multi-Modal-Transformer

Users that are interested in Multi-Modal-Transformer are comparing it to the libraries listed below

• facebookresearch / MeMViT
  Code Release for MeMViT Memory-Augmented Multiscale Vision Transformer for Efficient Long-Term Video Recognition, CVPR 2022
  ☆152Updated 3 years ago
• jackwu502 / NSVA
  The official implementation of our paper "Sports Video Analysis on Large-scale Data" (https://arxiv.org/abs/2208.04897)
  ☆79Updated 2 years ago
• amazon-science / video-contrastive-learning
  Video Contrastive Learning with Global Context, ICCVW 2021
  ☆161Updated 3 years ago
• phellonchen / awesome-Vision-and-Language-Pre-training
  Recent Advances in Vision and Language Pre-training (VLP)
  ☆296Updated 2 years ago
• salesforce / ALPRO
  Align and Prompt: Video-and-Language Pre-training with Entity Prompts
  ☆188Updated 7 months ago
• microsoft / UniCL
  [CVPR 2022] Official code for "Unified Contrastive Learning in Image-Text-Label Space"
  ☆403Updated 2 years ago
• ninatu / everything_at_once
  Official implementation of "Everything at Once - Multi-modal Fusion Transformer for Video Retrieval." CVPR 2022
  ☆115Updated 3 years ago
• microsoft / UniVL
  An official implementation for " UniVL: A Unified Video and Language Pre-Training Model for Multimodal Understanding and Generation"
  ☆364Updated last year
• daniel-code / TubeViT
  An unofficial implementation of TubeViT in "Rethinking Video ViTs: Sparse Video Tubes for Joint Image and Video Learning"
  ☆93Updated last year
• md-mohaiminul / ViS4mer
  ☆58Updated 3 weeks ago
• OpenGVLab / efficient-video-recognition
  ☆180Updated 3 years ago
• facebookresearch / AVT
  Code release for ICCV 2021 paper "Anticipative Video Transformer"
  ☆155Updated 3 years ago
• ju-chen / Efficient-Prompt
  ☆193Updated 3 years ago
• zeyun-zhong / AFFT
  Code for the paper: Anticipative Feature Fusion Transformer for Multi-Modal Action Anticipation.
  ☆32Updated 2 years ago
• ttengwang / PDVC
  End-to-End Dense Video Captioning with Parallel Decoding (ICCV 2021)
  ☆226Updated last year
• amazon-science / crossmodal-contrastive-learning
  CrossCLR: Cross-modal Contrastive Learning For Multi-modal Video Representations, ICCV 2021
  ☆64Updated 3 years ago
• xyzforever / BEVT
  PyTorch implementation of BEVT (CVPR 2022) https://arxiv.org/abs/2112.01529
  ☆164Updated 3 years ago
• facebookresearch / Motionformer
  Code + pre-trained models for the paper Keeping Your Eye on the Ball Trajectory Attention in Video Transformers
  ☆232Updated 3 years ago
• Yutong-Zhou-cv / Awesome-Multimodality
  A Survey on multimodal learning research.
  ☆334Updated 2 years ago
• ys-zong / awesome-self-supervised-multimodal-learning
  [T-PAMI] A curated list of self-supervised multimodal learning resources.
  ☆273Updated last year
• xuguohai / X-CLIP
  An official implementation for "X-CLIP: End-to-End Multi-grained Contrastive Learning for Video-Text Retrieval"
  ☆179Updated last year
• uta-smile / TCL
  code for TCL: Vision-Language Pre-Training with Triple Contrastive Learning, CVPR 2022
  ☆267Updated last year
• antoyang / TubeDETR
  [CVPR 2022 Oral] TubeDETR: Spatio-Temporal Video Grounding with Transformers
  ☆191Updated 2 years ago
• jayleicn / singularity
  [ACL 2023] Official PyTorch code for Singularity model in "Revealing Single Frame Bias for Video-and-Language Learning"
  ☆136Updated 2 years ago
• gabeur / mmt
  Multi-Modal Transformer for Video Retrieval
  ☆264Updated last year
• amazon-science / mix-generation
  MixGen: A New Multi-Modal Data Augmentation
  ☆126Updated 2 years ago
• naver-ai / pcme
  Official Pytorch implementation of "Probabilistic Cross-Modal Embedding" (CVPR 2021)
  ☆135Updated last year
• boheumd / A2Summ
  The official implementation of 'Align and Attend: Multimodal Summarization with Dual Contrastive Losses' (CVPR 2023)
  ☆82Updated 2 years ago
• ammesatyajit / VideoBERT
  Using VideoBERT to tackle video prediction
  ☆133Updated 4 years ago
• goel-shashank / CyCLIP
  ☆120Updated 2 years ago