This repository is build in association with our position paper on "Multimodality for NLP-Centered Applications: Resources, Advances and Frontiers". As a part of this release we share the information about recent multimodal datasets which are available for research purposes. We found that although 100+ multimodal language resources are availab…
☆341Jan 10, 2022Updated 4 years ago
Alternatives and similar repositories for Multimodal-datasets
Users that are interested in Multimodal-datasets are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆27Apr 25, 2022Updated 4 years ago
- ☆186Mar 20, 2020Updated 6 years ago
- Reading list for research topics in multimodal machine learning☆6,961Aug 20, 2024Updated 2 years ago
- EmoLLM: Multimodal Emotional Understanding Meets Large Language Models☆19Jun 24, 2024Updated 2 years ago
- ☆85Aug 9, 2021Updated 5 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Fine grained Empathy Direction Detection☆16Dec 11, 2020Updated 5 years ago
- code for EMNLP 2024 paper: Interpreting Arithmetic Mechanism in Large Language Models through Comparative Neuron Analysis☆12Nov 17, 2024Updated 2 years ago
- Scripts to evaluate various bias metrics for different NLG models + decoding algorithms☆16Dec 6, 2023Updated 2 years ago
- ☆13Jan 20, 2026Updated 9 months ago
- Recent Advances in Vision and Language Pre-training (VLP)☆296Jun 6, 2023Updated 3 years ago
- [LREC] MMChat: Multi-Modal Chat Dataset on Social Media☆110Sep 25, 2022Updated 4 years ago
- [NeurIPS 2021] Multiscale Benchmarks for Multimodal Representation Learning☆657Jan 27, 2024Updated 2 years ago
- ☆14Jan 7, 2016Updated 10 years ago
- M3ED: Multi-modal Multi-scene Multi-label Emotional Dialogue Database. ACL 2022☆132Sep 24, 2022Updated 4 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Official repository for Towards Multi-modal Transformers in Federated Learning (ECCV2024)☆21Feb 4, 2025Updated last year
- [KDD 2023] FedMultimodal: A Benchmark For Multimodal Federated Learning☆150May 24, 2025Updated last year
- repository for UniMSE: Towards Unified Multimodal Sentiment Analysis and Emotion Recognition☆206Sep 3, 2025Updated last year
- Official implementation of "MMNeuron: Discovering Neuron-Level Domain-Specific Interpretation in Multimodal Large Language Model". Our co…☆27Dec 20, 2024Updated last year
- [ACL2023] Code and dataset for paper "MMSD2.0: Towards a Reliable Multi-modal Sarcasm Detection System"☆62Jan 2, 2024Updated 2 years ago
- Codes for paper "Contextual Information and Commonsense Based Prompt for Emotion Recognition in Conversation" published in ECML-PKDD 2022…☆16Jul 6, 2022Updated 4 years ago
- ☆15Aug 25, 2023Updated 3 years ago
- IRFL: Image Recognition of Figurative Language☆12Nov 30, 2023Updated 2 years ago
- A Universal Platform for Training and Evaluation of Mobile Interaction☆64Sep 24, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversation☆1,100May 17, 2026Updated 6 months ago
- Framework for controlling demographic biases in NLG (using adversarial prompts)☆21Jun 12, 2023Updated 3 years ago
- WIT (Wikipedia-based Image Text) Dataset is a large multimodal multilingual dataset comprising 37M+ image-text sets with 11M+ unique imag…☆1,115Sep 27, 2024Updated 2 years ago
- CPED: A Large-Scale Chinese Personalized and Emotional Dialogue Dataset for Conversational AI | 中文个性情感对话数据集☆306Nov 10, 2022Updated 4 years ago
- Code for our EMNLP-2022 paper: "Language Prior Is Not the Only Shortcut: A Benchmark for Shortcut Learning in VQA"☆40Nov 1, 2022Updated 4 years ago
- Source code for ACL-IJCNLP 2021 paper "DialogueCRN: Contextual Reasoning Networks for Emotion Recognition in Conversations".☆62Oct 24, 2023Updated 3 years ago
- paper code commit-fsmafl☆10Mar 18, 2024Updated 2 years ago
- [ACL 2022] The source code of Multi-Modal Sarcasm Detection via Cross-Modal Graph Convolutional Network☆40Mar 20, 2023Updated 3 years ago
- Code and data for CIKM-2021 paper《Behind the Scenes: An Exploration of Trigger Biases Problem in Few-Shot Event Classification》☆11May 3, 2022Updated 4 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- MMSA is a unified framework for Multimodal Sentiment Analysis.☆1,077Jan 15, 2025Updated last year
- Modulated Fusion using Transformer for Linguistic-Acoustic Emotion Recognition☆33Dec 4, 2020Updated 5 years ago
- The code for the paper "Neutral Utterances are Also Causes: Enhancing Conversational Causal Emotion Entailment with Social Commonsense Kn…☆27May 22, 2022Updated 4 years ago
- Accelerating Vision-Language Pretraining with Free Language Modeling (CVPR 2023)☆31May 15, 2023Updated 3 years ago
- Source code of our paper "Focus on the Target’s Vocabulary: Masked Label Smoothing for Machine Translation" @ ACL 2022☆13Apr 13, 2022Updated 4 years ago
- Latest Advances on Multimodal Large Language Models☆18,091Oct 29, 2026Updated 3 weeks ago
- ☆47Nov 20, 2023Updated 2 years ago
Are these results useful?