Alternatives and similar repositories for MMTG:

Users that are interested in MMTG are comparing it to the libraries listed below

• SihengLi99 / TextBind
  [2024-ACL]: TextBind: Multi-turn Interleaved Multimodal Instruction-following in the Wildrounded Conversation
  ☆47Updated last year
• Aman-4-Real / awesome-multimodal-dialogue
  Paper, dataset and code list for multimodal dialogue.
  ☆20Updated 3 weeks ago
• AIM3-RUC / VideoIC
  Danmuku dataset
  ☆10Updated last year
• MichaelZhouwang / VLUE
  This repo contains codes and instructions for baselines in the VLUE benchmark.
  ☆41Updated 2 years ago
• MikeWangWZHL / VidIL
  Pytorch code for Language Models with Image Descriptors are Strong Few-Shot Video-Language Learners
  ☆113Updated 2 years ago
• zmykevin / UC2
  CVPR 2021 Official Pytorch Code for UC2: Universal Cross-lingual Cross-modal Vision-and-Language Pre-training
  ☆34Updated 3 years ago
• patrick-tssn / VSTAR
  [ACL2023] VSTAR is a multimodal dialogue dataset with scene and topic transition information
  ☆12Updated 3 months ago
• ChenDelong1999 / polite-flamingo
  🦩 Visual Instruction Tuning with Polite Flamingo - training multi-modal LLMs to be both clever and polite! (AAAI-24 Oral)
  ☆63Updated last year
• lscpku / VITATECS
  ☆17Updated 6 months ago
• guxu313 / TeViS
  ☆19Updated 10 months ago
• limanling / clip-event
  ☆101Updated 2 years ago
• lizekang / DSTC10-MOD
  DSTC10 Track1 - MOD: Internet Meme Incorporated Open-domain Dialog
  ☆50Updated last year
• VT-NLP / MultiInstruct
  MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuning
  ☆134Updated last year
• joez17 / VideoNIAH
  VideoNIAH: A Flexible Synthetic Method for Benchmarking Video MLLMs
  ☆33Updated 3 months ago
• open-vision-language / oven
  ☆29Updated last year
• bladewaltz1 / ModeCap
  Controllable mage captioning model with unsupervised modes
  ☆21Updated last year
• jayleicn / VideoLanguageFuturePred
  [EMNLP 2020] What is More Likely to Happen Next? Video-and-Language Future Event Prediction
  ☆48Updated 2 years ago
• allenai / aokvqa
  Official repository for the A-OKVQA dataset
  ☆71Updated 8 months ago
• jokieleung / Maria
  PyTorch implementation for ACL 2021 paper "Maria: A Visual Experience Powered Conversational Agent".
  ☆25Updated 3 years ago
• RifleZhang / LLaVA-Hound-DPO
  ☆136Updated 3 months ago
• doc-doc / NExT-QA
  NExT-QA: Next Phase of Question-Answering to Explaining Temporal Actions (CVPR'21)
  ☆141Updated 6 months ago
• Victorwz / VaLM
  VaLM: Visually-augmented Language Modeling. ICLR 2023.
  ☆56Updated last year
• MikeWangWZHL / Paxion
  Repo for paper: "Paxion: Patching Action Knowledge in Video-Language Foundation Models" Neurips 23 Spotlight
  ☆37Updated last year
• ictnlp / PLUVR
  Code for ACL 2022 main conference paper "Neural Machine Translation with Phrase-Level Universal Visual Representations".
  ☆21Updated last year
• YunxinLi / LingCloud
  Attaching human-like eyes to the large language model. The codes of IEEE TMM paper "LMEye: An Interactive Perception Network for Large La…
  ☆48Updated 6 months ago
• albertwy / GPT-4V-Evaluation
  Data for evaluating GPT-4V
  ☆11Updated last year
• RUCAIBox / CARP
  ☆16Updated last year
• yuezih / Movie101
  Narrative movie understanding benchmark
  ☆63Updated 8 months ago
• yytzsy / SMCG
  Code for the paper "Controllable Video Captioning with an Exemplar Sentence"
  ☆12Updated 3 years ago
• edchengg / infoseek_eval
  EMNLP2023 - InfoSeek: A New VQA Benchmark focus on Visual Info-Seeking Questions
  ☆17Updated 8 months ago