Jack-ZC8 / M3AV-dataset
[ACL 2024] A Multimodal, Multigenre, and Multipurpose Audio-Visual Academic Lecture Dataset
☆14Updated last week
Alternatives and similar repositories for M3AV-dataset:
Users that are interested in M3AV-dataset are comparing it to the libraries listed below
- A comprehensive overview of affective computing research in the era of large language models (LLMs).☆22Updated 8 months ago
- OpenOmni: Official implementation of Advancing Open-Source Omnimodal Large Language Models with Progressive Multimodal Alignment and Rea…☆40Updated last month
- ☆38Updated 8 months ago
- ☆37Updated last year
- ☆11Updated 2 months ago
- Instruct Once, Chat Consistently in Multiple Rounds: An Efficient Tuning Framework for Dialogue (ACL 2024)☆23Updated 8 months ago
- Pytorch Implementation of the Model from "MIRASOL3B: A MULTIMODAL AUTOREGRESSIVE MODEL FOR TIME-ALIGNED AND CONTEXTUAL MODALITIES"☆26Updated 2 months ago
- SpeechAgents: Human-Communication Simulation with Multi-Modal Multi-Agent Systems☆81Updated last year
- BLSP-Emo: Towards Empathetic Large Speech-Language Models☆43Updated 10 months ago
- ☆18Updated 10 months ago
- [AAAI 2024] DenoSent: A Denoising Objective for Self-Supervised Sentence Representation Learning☆16Updated 11 months ago
- ☆23Updated 7 months ago
- [ACM MM 2023] Official PyTorch implementation of "Emo-DNA: Emotion Decoupling and Alignment Learning for Cross-Corpus Speech Emotion Reco…☆11Updated last year
- Data for evaluating GPT-4V☆11Updated last year
- A project for tri-modal LLM benchmarking and instruction tuning.☆30Updated 3 weeks ago
- Datasets for turn-taking research☆12Updated last year
- source code for ICASSP 2022 paper: EmotionFlow: Capture the Dialogue Level Emotion Transitions☆27Updated 3 years ago
- AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension☆89Updated 4 months ago
- ☆23Updated 6 months ago
- This is the official code repository of ICLR 2023 Tiny Paper, "Hierarchical Dialogue Understanding with Special Tokens and Turn-level Att…☆19Updated last year
- The dataset and baseline code for Text-to-Audio Grounding (TAG)☆42Updated 3 months ago
- Interpretable unified language safety checking with large language models☆30Updated 2 years ago
- ☆12Updated 4 months ago
- The official code of our paper at EMNLP 2022: Back to the Future: Bidirectional Information Decoupling Network for Multi-turn Dialogue Mo…☆16Updated 2 years ago
- ☆45Updated this week
- BLSP: Bootstrapping Langauge-Speech Pre-training via Behavior Alignment of Continuation Writing☆50Updated last year
- GPT-4V with Emotion☆90Updated last year
- [NAACL 2024] Better Zero-Shot Reasoning with Role-Play Prompting☆33Updated last year
- 🍼 Official implementation of Dynamic Data Mixing Maximizes Instruction Tuning for Mixture-of-Experts☆38Updated 6 months ago
- Code for ACL 2023 main conference paper "CMOT: Cross-modal Mixup via Optimal Transport for Speech Translation"☆18Updated 5 months ago