This repository is build in association with our position paper on "Multimodality for NLP-Centered Applications: Resources, Advances and Frontiers". As a part of this release we share the information about recent multimodal datasets which are available for research purposes. We found that although 100+ multimodal language resources are availab…
☆336Jan 10, 2022Updated 4 years ago
Alternatives and similar repositories for Multimodal-datasets
Users that are interested in Multimodal-datasets are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆187Mar 20, 2020Updated 6 years ago
- Fine grained Empathy Direction Detection☆16Dec 11, 2020Updated 5 years ago
- Reading list for research topics in multimodal machine learning☆6,877Aug 20, 2024Updated last year
- Multimodal Sarcasm Detection Dataset☆376Aug 22, 2024Updated last year
- code for EMNLP 2024 paper: Interpreting Arithmetic Mechanism in Large Language Models through Comparative Neuron Analysis☆12Nov 17, 2024Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Scripts to evaluate various bias metrics for different NLG models + decoding algorithms☆16Dec 6, 2023Updated 2 years ago
- Official implementation of "MMNeuron: Discovering Neuron-Level Domain-Specific Interpretation in Multimodal Large Language Model". Our co…☆26Dec 20, 2024Updated last year
- Code Repository For ACL2021 Paper - DynaEval: Unifying Turn and Dialogue Level Evaluation☆12Sep 2, 2022Updated 3 years ago
- EMER, OV-MER (ICML25), AffectGPT (ICML25, Oral), EmoPrefer (ICLR26)☆390Feb 24, 2026Updated 3 months ago
- Official repository for Towards Multi-modal Transformers in Federated Learning (ECCV2024)☆21Feb 4, 2025Updated last year
- ☆17Mar 20, 2025Updated last year
- IRFL: Image Recognition of Figurative Language☆11Nov 30, 2023Updated 2 years ago
- Recent Advances in Vision and Language Pre-training (VLP)☆297Jun 6, 2023Updated 2 years ago
- Original PyTorch Implementation for the EMNLP 2023 Paper "Beyond Detection: A Defend-and-Summarize Strategy for Robust and Interpretable …☆16Dec 14, 2023Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- [ACL 2022] The source code of Multi-Modal Sarcasm Detection via Cross-Modal Graph Convolutional Network☆40Mar 20, 2023Updated 3 years ago
- ☆86Aug 9, 2021Updated 4 years ago
- [ACL2023] Code and dataset for paper "MMSD2.0: Towards a Reliable Multi-modal Sarcasm Detection System"☆60Jan 2, 2024Updated 2 years ago
- Multimodal Model for Memotion Dataset☆12May 17, 2021Updated 5 years ago
- ☆15Dec 10, 2021Updated 4 years ago
- CPED: A Large-Scale Chinese Personalized and Emotional Dialogue Dataset for Conversational AI | 中文个性情感对话数据集☆284Nov 10, 2022Updated 3 years ago
- Source code of our paper "Focus on the Target’s Vocabulary: Masked Label Smoothing for Machine Translation" @ ACL 2022☆13Apr 13, 2022Updated 4 years ago
- ☆31Jul 23, 2025Updated 10 months ago
- [LREC] MMChat: Multi-Modal Chat Dataset on Social Media☆110Sep 25, 2022Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆31Jan 28, 2026Updated 4 months ago
- This repository provides a comprehensive collection of research papers focused on multimodal representation learning, all of which have b…☆84Jun 16, 2025Updated 11 months ago
- It is the implementation of paper "Multi-Modal Sarcasm Detection in Twitter with Hierarchical Fusion Model"☆18Feb 19, 2021Updated 5 years ago
- Some papers about *diverse* image (a few videos) captioning☆26Apr 4, 2023Updated 3 years ago
- Official pytorch implementation of MuST: Multi-Scale Transformers for Surgical Phase Recognition MICCAI 2024☆18Jan 13, 2025Updated last year
- [KDD 2023] FedMultimodal: A Benchmark For Multimodal Federated Learning☆145May 24, 2025Updated last year
- MFAQ: a Multilingual FAQ Dataset☆18Sep 17, 2023Updated 2 years ago
- The code for the paper "Neutral Utterances are Also Causes: Enhancing Conversational Causal Emotion Entailment with Social Commonsense Kn…☆27May 22, 2022Updated 4 years ago
- MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversation☆1,051May 17, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Humor Knowledge Enriched Transformer☆32Oct 20, 2021Updated 4 years ago
- This repo contains code for our NeurIPS 2023 spotlight paper: Evaluating and Inducing Personality in Pre-trained Language Models☆59Dec 7, 2023Updated 2 years ago
- ☆25Aug 1, 2024Updated last year
- Question-Directed Graph Attention Network for Numerical Reasoning over Text☆10Aug 14, 2020Updated 5 years ago
- Source code and data used in the papers ViQuAE (Lerner et al., SIGIR'22), Multimodal ICT (Lerner et al., ECIR'23) and Cross-modal Retriev…☆38Dec 19, 2024Updated last year
- ☆13Apr 13, 2026Updated last month
- Latest Advances on Multimodal Large Language Models☆17,829May 1, 2026Updated 3 weeks ago