Alternatives and similar repositories for MMTG

Users that are interested in MMTG are comparing it to the libraries listed below

• Aman-4-Real / awesome-multimodal-dialogue
  Paper, dataset and code list for multimodal dialogue.
  ☆22Updated 9 months ago
• victorsungo / MMDialog
  The official site of paper MMDialog: A Large-scale Multi-turn Dialogue Dataset Towards Multi-modal Open-domain Conversation
  ☆201Updated 2 years ago
• SihengLi99 / TextBind
  [2024-ACL]: TextBind: Multi-turn Interleaved Multimodal Instruction-following in the Wildrounded Conversation
  ☆46Updated 2 years ago
• MikeWangWZHL / VidIL
  Pytorch code for Language Models with Image Descriptors are Strong Few-Shot Video-Language Learners
  ☆115Updated 3 years ago
• ictnlp / PLUVR
  Code for ACL 2022 main conference paper "Neural Machine Translation with Phrase-Level Universal Visual Representations".
  ☆21Updated 2 years ago
• YunxinLi / LingCloud
  Attaching human-like eyes to the large language model. The codes of IEEE TMM paper "LMEye: An Interactive Perception Network for Large La…
  ☆48Updated last year
• TobiasLee / VEC
  Visual and Embodied Concepts evaluation benchmark
  ☆21Updated 2 years ago
• PLUM-Lab / MultiInstruct
  MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuning
  ☆134Updated 2 years ago
• yuezih / Movie101
  Narrative movie understanding benchmark
  ☆76Updated 4 months ago
• MichaelZhouwang / VLUE
  This repo contains codes and instructions for baselines in the VLUE benchmark.
  ☆41Updated 3 years ago
• RUC-AIMind / TikTalk
  ☆69Updated 5 months ago
• ChartMimic / ChartMimic
  [ICLR 2025] ChartMimic: Evaluating LMM’s Cross-Modal Reasoning Capability via Chart-to-Code Generation
  ☆124Updated 4 months ago
• Aman-4-Real / See-or-Guess
  [ACM MM 2024] See or Guess: Counterfactually Regularized Image Captioning
  ☆14Updated 8 months ago
• AIM3-RUC / VideoIC
  Danmuku dataset
  ☆11Updated 2 years ago
• jssprz / video_captioning_datasets
  Summary about Video-to-Text datasets. This repository is part of the review paper *Bridging Vision and Language from the Video-to-Text Pe…
  ☆130Updated 2 years ago
• VRU-NExT / VideoQA
  ☆98Updated 3 years ago
• albertwy / GPT-4V-Evaluation
  Data for evaluating GPT-4V
  ☆11Updated 2 years ago
• Yui010206 / SeViLA
  [NeurIPS 2023] Self-Chained Image-Language Model for Video Localization and Question Answering
  ☆189Updated last year
• patrick-tssn / VSTAR
  [ACL 2023] VSTAR is a multimodal dialogue dataset with scene and topic transition information
  ☆15Updated last year
• ChenDelong1999 / polite-flamingo
  🦩 Visual Instruction Tuning with Polite Flamingo - training multi-modal LLMs to be both clever and polite! (AAAI-24 Oral)
  ☆63Updated last year
• open-vision-language / oven
  ☆40Updated 2 years ago
• patrick-tssn / Awesome-Colorful-LLM
  Recent advancements propelled by large language models (LLMs), encompassing an array of domains including Vision, Audio, Agent, Robotics,…
  ☆123Updated 5 months ago
• edchengg / infoseek_eval
  EMNLP2023 - InfoSeek: A New VQA Benchmark focus on Visual Info-Seeking Questions
  ☆25Updated last year
• irfl-dataset / IRFL
  IRFL: Image Recognition of Figurative Language
  ☆11Updated last year
• ShannonAI / OpenViDial
  Code, Models and Datasets for OpenViDial Dataset
  ☆132Updated 3 years ago
• lscpku / VITATECS
  ☆18Updated last year
• RifleZhang / LLaVA-Hound-DPO
  ☆155Updated last year
• TIGER-AI-Lab / UniIR
  Official code for paper "UniIR: Training and Benchmarking Universal Multimodal Information Retrievers" (ECCV 2024)
  ☆166Updated last year
• jokieleung / Maria
  PyTorch implementation for ACL 2021 paper "Maria: A Visual Experience Powered Conversational Agent".
  ☆24Updated 4 years ago
• allenai / aokvqa
  Official repository for the A-OKVQA dataset
  ☆102Updated last year