Alternatives and similar repositories for MMTG:

Users that are interested in MMTG are comparing it to the libraries listed below

• SihengLi99 / TextBind
  [2024-ACL]: TextBind: Multi-turn Interleaved Multimodal Instruction-following in the Wildrounded Conversation
  ☆47Updated last year
• Aman-4-Real / awesome-multimodal-dialogue
  Paper, dataset and code list for multimodal dialogue.
  ☆20Updated last month
• patrick-tssn / VSTAR
  [ACL2023] VSTAR is a multimodal dialogue dataset with scene and topic transition information
  ☆12Updated 3 months ago
• open-vision-language / infoseek
  ☆39Updated last year
• MichaelZhouwang / VLUE
  This repo contains codes and instructions for baselines in the VLUE benchmark.
  ☆41Updated 2 years ago
• albertwy / GPT-4V-Evaluation
  Data for evaluating GPT-4V
  ☆11Updated last year
• joez17 / ChatBridge
  ChatBridge, an approach to learning a unified multimodal model to interpret, correlate, and reason about various modalities without rely…
  ☆49Updated last year
• open-vision-language / oven
  ☆31Updated last year
• limanling / clip-event
  ☆101Updated 2 years ago
• yuezih / Movie101
  Narrative movie understanding benchmark
  ☆65Updated 9 months ago
• AIM3-RUC / VideoIC
  Danmuku dataset
  ☆10Updated last year
• MikeWangWZHL / VidIL
  Pytorch code for Language Models with Image Descriptors are Strong Few-Shot Video-Language Learners
  ☆113Updated 2 years ago
• zengyan-97 / CCLM
  Cross-View Language Modeling: Towards Unified Cross-Lingual Cross-Modal Pre-training (ACL 2023))
  ☆89Updated last year
• VT-NLP / MultiInstruct
  MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuning
  ☆134Updated last year
• doc-doc / NExT-QA
  NExT-QA: Next Phase of Question-Answering to Explaining Temporal Actions (CVPR'21)
  ☆142Updated 6 months ago
• zmykevin / UC2
  CVPR 2021 Official Pytorch Code for UC2: Universal Cross-lingual Cross-modal Vision-and-Language Pre-training
  ☆34Updated 3 years ago
• ictnlp / PLUVR
  Code for ACL 2022 main conference paper "Neural Machine Translation with Phrase-Level Universal Visual Representations".
  ☆21Updated last year
• LightChen233 / M3CoT
  ☆60Updated 8 months ago
• yytzsy / SMCG
  Code for the paper "Controllable Video Captioning with an Exemplar Sentence"
  ☆12Updated 3 years ago
• ChenDelong1999 / polite-flamingo
  🦩 Visual Instruction Tuning with Polite Flamingo - training multi-modal LLMs to be both clever and polite! (AAAI-24 Oral)
  ☆63Updated last year
• allenai / aokvqa
  Official repository for the A-OKVQA dataset
  ☆73Updated 9 months ago
• luomancs / ReMuQ
  a multimodal retrieval dataset
  ☆22Updated last year
• guxu313 / TeViS
  ☆20Updated 10 months ago
• edchengg / infoseek_eval
  EMNLP2023 - InfoSeek: A New VQA Benchmark focus on Visual Info-Seeking Questions
  ☆18Updated 8 months ago
• scofield7419 / UMMT-VSH
  Code for the ACL 2023 paper Scene Graph as Pivoting: Inference-time Image-free Unsupervised Multimodal Machine Translation with Visual Sc…
  ☆13Updated last year
• VRU-NExT / VideoQA
  ☆89Updated 2 years ago
• chuhaojin / WenLan-api-document
  The Document of WenLan API, which was used to obtain image and text feature.
  ☆37Updated 2 years ago
• joez17 / VideoNIAH
  VideoNIAH: A Flexible Synthetic Method for Benchmarking Video MLLMs
  ☆37Updated 3 months ago
• ShannonAI / OpenViDial
  Code, Models and Datasets for OpenViDial Dataset
  ☆131Updated 3 years ago