Jack-ZC8 / M3AV-datasetLinks
[ACL 2024] A Multimodal, Multigenre, and Multipurpose Audio-Visual Academic Lecture Dataset
☆18Updated 3 months ago
Alternatives and similar repositories for M3AV-dataset
Users that are interested in M3AV-dataset are comparing it to the libraries listed below
Sorting:
- ☆11Updated last week
- SpeechAgents: Human-Communication Simulation with Multi-Modal Multi-Agent Systems☆83Updated last year
- ☆40Updated last year
- A project for tri-modal LLM benchmarking and instruction tuning.☆42Updated 5 months ago
- A comprehensive overview of affective computing research in the era of large language models (LLMs).☆25Updated last year
- [AAAI 2024] DenoSent: A Denoising Objective for Self-Supervised Sentence Representation Learning☆15Updated last year
- ☆37Updated last year
- ☆19Updated last year
- MIntRec: A New Dataset for Multimodal Intent Recognition (ACM MM 2022)☆103Updated 3 months ago
- Pytorch Implementation of the Model from "MIRASOL3B: A MULTIMODAL AUTOREGRESSIVE MODEL FOR TIME-ALIGNED AND CONTEXTUAL MODALITIES"☆26Updated 7 months ago
- ☆13Updated 2 months ago
- ☆22Updated 4 months ago
- The official code of our paper at EMNLP 2022: Back to the Future: Bidirectional Information Decoupling Network for Multi-turn Dialogue Mo…☆16Updated 2 years ago
- MIntRec2.0 is the first large-scale dataset for multimodal intent recognition and out-of-scope detection in multi-party conversations (IC…☆57Updated 2 weeks ago
- ☆48Updated last week
- Instruct Once, Chat Consistently in Multiple Rounds: An Efficient Tuning Framework for Dialogue (ACL 2024)☆23Updated last year
- ☆25Updated 3 months ago
- AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension☆114Updated 8 months ago
- code for paper "Cross-modal Contrastive Learning for Speech Translation" (NAACL 2022)☆64Updated 3 years ago
- EchoInk-R1: Exploring Audio-Visual Reasoning in Multimodal LLMs via Reinforcement Learning [🔥The Exploration of R1 for General Audio-Vi…☆53Updated 3 months ago
- ☆105Updated 2 weeks ago
- EACL 2023 paper "MLASK: Multimodal Summarization of Video-based News Articles"☆12Updated last year
- a fully open-source implementation of a GPT-4o-like speech-to-speech video understanding model.☆25Updated 4 months ago
- This is the official code repository of ICLR 2023 Tiny Paper, "Hierarchical Dialogue Understanding with Special Tokens and Turn-level Att…☆19Updated 2 years ago
- Repo for paper "Tell Me More! Towards Implicit User Intention Understanding of Language Model Driven Agents"☆56Updated last year
- Code for ACL 2023 main conference paper "CMOT: Cross-modal Mixup via Optimal Transport for Speech Translation"☆18Updated 10 months ago
- NAACL 2022: MCSE: Multimodal Contrastive Learning of Sentence Embeddings☆56Updated last year
- ⚡Research papers about leveraging the capabilities of language models⚡☆52Updated 2 years ago
- Code for ACL 2022 main conference paper "STEMM: Self-learning with Speech-text Manifold Mixup for Speech Translation".☆36Updated last year
- [Findings of NAACL 2024] Emotion-Anchored Contrastive Learning Framework for Emotion Recognition in Conversation☆34Updated 9 months ago