Jack-ZC8 / M3AV-datasetLinks
[ACL 2024] A Multimodal, Multigenre, and Multipurpose Audio-Visual Academic Lecture Dataset
☆16Updated last month
Alternatives and similar repositories for M3AV-dataset
Users that are interested in M3AV-dataset are comparing it to the libraries listed below
Sorting:
- A comprehensive overview of affective computing research in the era of large language models (LLMs).☆23Updated 11 months ago
- ☆39Updated 11 months ago
- ☆11Updated 4 months ago
- ☆37Updated last year
- [AAAI 2024] DenoSent: A Denoising Objective for Self-Supervised Sentence Representation Learning☆16Updated last year
- Pytorch Implementation of the Model from "MIRASOL3B: A MULTIMODAL AUTOREGRESSIVE MODEL FOR TIME-ALIGNED AND CONTEXTUAL MODALITIES"☆26Updated 5 months ago
- SpeechAgents: Human-Communication Simulation with Multi-Modal Multi-Agent Systems☆82Updated last year
- Code for ACL 2023 main conference paper "CMOT: Cross-modal Mixup via Optimal Transport for Speech Translation"☆18Updated 8 months ago
- ☆25Updated 2 months ago
- ☆18Updated last year
- Code for ACL 2022 main conference paper "STEMM: Self-learning with Speech-text Manifold Mixup for Speech Translation".☆36Updated last year
- A project for tri-modal LLM benchmarking and instruction tuning.☆40Updated 3 months ago
- a fully open-source implementation of a GPT-4o-like speech-to-speech video understanding model.☆20Updated 3 months ago
- OpenOmni: Official implementation of Advancing Open-Source Omnimodal Large Language Models with Progressive Multimodal Alignment and Rea…☆89Updated 2 weeks ago
- The code for AAAI 2025 “Large Language Models Are Read/Write Policy-Makers for Simultaneous Generation”☆13Updated 6 months ago
- Instruct Once, Chat Consistently in Multiple Rounds: An Efficient Tuning Framework for Dialogue (ACL 2024)☆23Updated 11 months ago
- MIntRec: A New Dataset for Multimodal Intent Recognition (ACM MM 2022)☆96Updated 2 months ago
- code for paper "Cross-modal Contrastive Learning for Speech Translation" (NAACL 2022)☆65Updated 3 years ago
- Interpretable unified language safety checking with large language models☆31Updated 2 years ago
- This is the official code repository of ICLR 2023 Tiny Paper, "Hierarchical Dialogue Understanding with Special Tokens and Turn-level Att…☆19Updated 2 years ago
- ☆22Updated 2 months ago
- The official code of our paper at EMNLP 2022: Back to the Future: Bidirectional Information Decoupling Network for Multi-turn Dialogue Mo…☆16Updated 2 years ago
- EACL 2023 paper "MLASK: Multimodal Summarization of Video-based News Articles"☆12Updated last year
- Code for NeurIPS 2023 paper "DASpeech: Directed Acyclic Transformer for Fast and High-quality Speech-to-Speech Translation".☆63Updated 11 months ago
- [ICASSP2024] Code for paper "SDIF-DA: A Shallow-to-Deep Interaction Framework with Data Augmentation for Multi-modal Intent Detection"☆11Updated last year
- BLSP-Emo: Towards Empathetic Large Speech-Language Models☆47Updated last year
- source code for ICASSP 2022 paper: EmotionFlow: Capture the Dialogue Level Emotion Transitions☆27Updated 3 years ago
- AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension☆107Updated 7 months ago
- [NAACL 2024] Better Zero-Shot Reasoning with Role-Play Prompting☆36Updated last year
- ☆47Updated last month