Jack-ZC8 / M3AV-datasetLinks
[ACL 2024] A Multimodal, Multigenre, and Multipurpose Audio-Visual Academic Lecture Dataset
☆19Updated 6 months ago
Alternatives and similar repositories for M3AV-dataset
Users that are interested in M3AV-dataset are comparing it to the libraries listed below
Sorting:
- ☆42Updated last year
- A project for tri-modal LLM benchmarking and instruction tuning.☆52Updated 8 months ago
- SpeechAgents: Human-Communication Simulation with Multi-Modal Multi-Agent Systems☆84Updated last year
- ☆19Updated last year
- [AAAI 2024] DenoSent: A Denoising Objective for Self-Supervised Sentence Representation Learning☆15Updated last year
- A comprehensive overview of affective computing research in the era of large language models (LLMs).☆27Updated last year
- ☆11Updated 3 months ago
- ☆37Updated 2 years ago
- ☆25Updated 7 months ago
- ☆121Updated 3 months ago
- Pytorch Implementation of the Model from "MIRASOL3B: A MULTIMODAL AUTOREGRESSIVE MODEL FOR TIME-ALIGNED AND CONTEXTUAL MODALITIES"☆26Updated 10 months ago
- (NIPS 2025) OpenOmni: Official implementation of Advancing Open-Source Omnimodal Large Language Models with Progressive Multimodal Align…☆113Updated last month
- EchoInk-R1: Exploring Audio-Visual Reasoning in Multimodal LLMs via Reinforcement Learning [🔥The Exploration of R1 for General Audio-Vi…☆68Updated 6 months ago
- ☆26Updated 7 months ago
- Instruct Once, Chat Consistently in Multiple Rounds: An Efficient Tuning Framework for Dialogue (ACL 2024)☆24Updated last month
- The official code of our paper at EMNLP 2022: Back to the Future: Bidirectional Information Decoupling Network for Multi-turn Dialogue Mo…☆16Updated 2 years ago
- ☆70Updated 2 months ago
- MIntRec2.0 is the first large-scale dataset for multimodal intent recognition and out-of-scope detection in multi-party conversations (IC…☆69Updated 4 months ago
- ☆50Updated this week
- AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension☆124Updated last year
- code for paper "Cross-modal Contrastive Learning for Speech Translation" (NAACL 2022)☆65Updated 3 years ago
- [ACL24] EmoBench: Evaluating the Emotional Intelligence of Large Language Models☆100Updated 6 months ago
- Evaluate your agent memory on real-world dialogues, not LLM-simulated dialogues.☆35Updated 5 months ago
- Repo for paper "Tell Me More! Towards Implicit User Intention Understanding of Language Model Driven Agents"☆58Updated last year
- Code for ACL 2022 main conference paper "STEMM: Self-learning with Speech-text Manifold Mixup for Speech Translation".☆36Updated 2 years ago
- RewardAnything: Generalizable Principle-Following Reward Models☆45Updated 6 months ago
- Code for ACL 2023 main conference paper "CMOT: Cross-modal Mixup via Optimal Transport for Speech Translation"☆18Updated last year
- MIntRec: A New Dataset for Multimodal Intent Recognition (ACM MM 2022)☆122Updated 7 months ago
- The official repo of Qwen2-Audio chat & pretrained large audio language model proposed by Alibaba Cloud.☆37Updated last year
- ☆16Updated 5 months ago