Alternatives and similar repositories for Multi-Modal-Transformer

Users that are interested in Multi-Modal-Transformer are comparing it to the libraries listed below

• uta-smile / TCL
  code for TCL: Vision-Language Pre-Training with Triple Contrastive Learning, CVPR 2022
  ☆265Updated 11 months ago
• ttengwang / PDVC
  End-to-End Dense Video Captioning with Parallel Decoding (ICCV 2021)
  ☆222Updated last year
• phellonchen / awesome-Vision-and-Language-Pre-training
  Recent Advances in Vision and Language Pre-training (VLP)
  ☆294Updated 2 years ago
• salesforce / ALPRO
  Align and Prompt: Video-and-Language Pre-training with Entity Prompts
  ☆188Updated 4 months ago
• ju-chen / Efficient-Prompt
  ☆192Updated 2 years ago
• ninatu / everything_at_once
  Official implementation of "Everything at Once - Multi-modal Fusion Transformer for Video Retrieval." CVPR 2022
  ☆111Updated 3 years ago
• xuguohai / X-CLIP
  An official implementation for "X-CLIP: End-to-End Multi-grained Contrastive Learning for Video-Text Retrieval"
  ☆172Updated last year
• ylsung / VL_adapter
  PyTorch code for "VL-Adapter: Parameter-Efficient Transfer Learning for Vision-and-Language Tasks" (CVPR2022)
  ☆206Updated 2 years ago
• microsoft / UniVL
  An official implementation for " UniVL: A Unified Video and Language Pre-Training Model for Multimodal Understanding and Generation"
  ☆361Updated last year
• jayleicn / singularity
  [ACL 2023] Official PyTorch code for Singularity model in "Revealing Single Frame Bias for Video-and-Language Learning"
  ☆135Updated 2 years ago
• md-mohaiminul / ViS4mer
  ☆56Updated 3 years ago
• xyzforever / BEVT
  PyTorch implementation of BEVT (CVPR 2022) https://arxiv.org/abs/2112.01529
  ☆164Updated 3 years ago
• antoyang / TubeDETR
  [CVPR 2022 Oral] TubeDETR: Spatio-Temporal Video Grounding with Transformers
  ☆185Updated last year
• ammesatyajit / VideoBERT
  Using VideoBERT to tackle video prediction
  ☆132Updated 4 years ago
• facebookresearch / MeMViT
  Code Release for MeMViT Memory-Augmented Multiscale Vision Transformer for Efficient Long-Term Video Recognition, CVPR 2022
  ☆149Updated 2 years ago
• amazon-science / mix-generation
  MixGen: A New Multi-Modal Data Augmentation
  ☆126Updated 2 years ago
• Yutong-Zhou-cv / Awesome-Multimodality
  A Survey on multimodal learning research.
  ☆330Updated 2 years ago
• naver-ai / pcme
  Official Pytorch implementation of "Probabilistic Cross-Modal Embedding" (CVPR 2021)
  ☆133Updated last year
• facebookresearch / AVT
  Code release for ICCV 2021 paper "Anticipative Video Transformer"
  ☆153Updated 3 years ago
• OpenGVLab / efficient-video-recognition
  ☆177Updated 3 years ago
• microsoft / UniCL
  [CVPR 2022] Official code for "Unified Contrastive Learning in Image-Text-Label Space"
  ☆402Updated last year
• antoyang / just-ask
  [ICCV 2021 Oral + TPAMI] Just Ask: Learning to Answer Questions from Millions of Narrated Videos
  ☆123Updated last year
• amazon-science / video-contrastive-learning
  Video Contrastive Learning with Global Context, ICCVW 2021
  ☆159Updated 3 years ago
• zdou0830 / METER
  METER: A Multimodal End-to-end TransformER Framework
  ☆373Updated 2 years ago
• amazon-science / crossmodal-contrastive-learning
  CrossCLR: Cross-modal Contrastive Learning For Multi-modal Video Representations, ICCV 2021
  ☆64Updated 3 years ago
• showlab / all-in-one
  [CVPR2023] All in One: Exploring Unified Video-Language Pre-training
  ☆282Updated 2 years ago
• ys-zong / awesome-self-supervised-multimodal-learning
  [T-PAMI] A curated list of self-supervised multimodal learning resources.
  ☆263Updated last year
• boheumd / A2Summ
  The official implementation of 'Align and Attend: Multimodal Summarization with Dual Contrastive Losses' (CVPR 2023)
  ☆79Updated 2 years ago
• microsoft / SwinBERT
  Research code for CVPR 2022 paper "SwinBERT: End-to-End Transformers with Sparse Attention for Video Captioning"
  ☆245Updated 3 years ago
• davidnvq / grit
  GRIT: Faster and Better Image-captioning Transformer (ECCV 2022)
  ☆195Updated 2 years ago