Alternatives and similar repositories for MC-ViT:

Users that are interested in MC-ViT are comparing it to the libraries listed below

• kahnchana / mvu
  Multimodal Video Understanding Framework (MVU)
  ☆27Updated 8 months ago
• top-yun / SPARK
  A benchmark dataset and simple code examples for measuring the perception and reasoning of multi-sensor Vision Language models.
  ☆16Updated last month
• eric-ai-lab / ComCLIP
  Official implementation and dataset for the NAACL 2024 paper "ComCLIP: Training-Free Compositional Image and Text Matching"
  ☆35Updated 5 months ago
• MCR-PEFT / Ex-MCR
  ☆41Updated last year
• FactoDeepLearning / MultitaskVLFM
  ☆25Updated last year
• SHI-Labs / OLA-VLM
  OLA-VLM: Elevating Perception in Multimodal LLMs with Auxiliary Embedding Distillation, arXiv 2024
  ☆47Updated this week
• kkahatapitiya / LangRepo
  Language Repository for Long Video Understanding
  ☆31Updated 7 months ago
• LaVi-Lab / Visual-Table
  [EMNLP 2024] Official code for "Beyond Embeddings: The Promise of Visual Table in Multi-Modal Models"
  ☆14Updated 3 months ago
• mlvlab / RALF
  Official implementation of CVPR 2024 paper "Retrieval-Augmented Open-Vocabulary Object Detection".
  ☆32Updated 4 months ago
• jeykigung / HiCLIP
  ☆29Updated last year
• QUVA-Lab / PIN
  Official code repo of PIN: Positional Insert Unlocks Object Localisation Abilities in VLMs
  ☆25Updated 2 weeks ago
• Hao840 / ADEM-VL
  PyTorch code for "ADEM-VL: Adaptive and Embedded Fusion for Efficient Vision-Language Tuning"
  ☆18Updated 3 months ago
• kyegomez / PaLM2-VAdapter
  Implementation of "PaLM2-VAdapter:" from the multi-modal model paper: "PaLM2-VAdapter: Progressively Aligned Language Model Makes a Stron…
  ☆16Updated 2 months ago
• LgQu / TIGeR
  Code for paper: Unified Text-to-Image Generation and Retrieval
  ☆13Updated 6 months ago
• locuslab / llava-token-compression
  ☆37Updated 2 months ago
• RenShuhuai-Andy / TESTA
  [EMNLP 2023] TESTA: Temporal-Spatial Token Aggregation for Long-form Video-Language Understanding
  ☆49Updated last year
• NVlabs / STL
  Official Pytorch Implementation of Self-emerging Token Labeling
  ☆32Updated 10 months ago
• htqin / GoogleBard-VisUnderstand
  How Good is Google Bard's Visual Understanding? An Empirical Study on Open Challenges
  ☆30Updated last year
• sunsmarterjie / ChatterBox
  [AAAI2025] ChatterBox: Multi-round Multimodal Referring and Grounding, Multimodal, Multi-round dialogues
  ☆50Updated last month
• kyegomez / Mirasol
  Pytorch Implementation of the Model from "MIRASOL3B: A MULTIMODAL AUTOREGRESSIVE MODEL FOR TIME-ALIGNED AND CONTEXTUAL MODALITIES"
  ☆26Updated this week
• ethanlshen / HierNet
  Code for "Are “Hierarchical” Visual Representations Hierarchical?" in NeurIPS Workshop for Symmetry and Geometry in Neural Representation…
  ☆20Updated last year
• SMILE-data / SMILE
  SMILE: A Multimodal Dataset for Understanding Laughter
  ☆13Updated last year
• Shahzadnit / EZ-CLIP
  ☆17Updated 9 months ago
• JerryYLi / svitt
  Code for CVPR 2023 paper "SViTT: Temporal Learning of Sparse Video-Text Transformers"
  ☆18Updated last year
• mlvlab / vid-TLDR
  Official implementation of CVPR 2024 paper "vid-TLDR: Training Free Token merging for Light-weight Video Transformer".
  ☆44Updated 8 months ago
• mlvlab / DAPT
  Distribution-Aware Prompt Tuning for Vision-Language Models (ICCV 2023)
  ☆38Updated last year
• csarron / PuMer
  [ACL 2023] PuMer: Pruning and Merging Tokens for Efficient Vision Language Models
  ☆29Updated 3 months ago
• showlab / VisInContext
  Official implementation of Leveraging Visual Tokens for Extended Text Contexts in Multi-Modal Learning
  ☆14Updated 3 months ago
• OpenGVLab / vinci
  Vinci: A Real-time Embodied Smart Assistant based on Egocentric Vision-Language Model
  ☆38Updated 2 weeks ago