X-LANCE / MSDWILDLinks
[INTERSPEECH 2022] This dataset is designed for multi-modal speaker diarization and lip-speech synchronization in the wild.
☆58Updated 2 years ago
Alternatives and similar repositories for MSDWILD
Users that are interested in MSDWILD are comparing it to the libraries listed below
Sorting:
- ☆70Updated last year
- ☆48Updated 3 years ago
- A Multi-Task Evaluation Benchmark for Audio-Visual Representation Models (ICASSP 2024)☆58Updated last year
- Official implementation for Fast-HuBERT: An Efficient Training Framework for Self-Supervised Speech Representation Learning☆96Updated last year
- The implementation for "Large Language Model Can Transcribe Speech in Multi-Talker Scenarios with Versatile Instructions"☆50Updated 9 months ago
- Official implementation of RAVEn (ICLR 2023) and BRAVEn (ICASSP 2024)☆77Updated 11 months ago
- Official Implementation of EnCLAP (ICASSP 2024)☆94Updated last year
- INTERSPEECH 2023: "DPHuBERT: Joint Distillation and Pruning of Self-Supervised Speech Models"☆116Updated 2 years ago
- Implementation of the paper "Self-supervised Learning with Random-projection Quantizer for Speech Recognition" in Pytorch.☆89Updated 2 years ago
- 《SpeechPrompt v2: Prompt Tuning for Speech Classification Tasks》Speech processing with prompting paradigm☆82Updated 2 years ago
- Evaluation Protocol for Large-Scale Zero-Shot TTS Literature☆92Updated 10 months ago
- INTERSPEECH2023: Target Active Speaker Detection with Audio-visual Cues☆57Updated 2 years ago
- The Introduction of the OLKAVS Dataset☆36Updated last year
- X-E-Speech: Joint Training Framework of Non-Autoregressive Cross-lingual Emotional Text-to-Speech and Voice Conversion☆111Updated last year
- Emotion Rendering for Conversational Speech Synthesis with Heterogeneous Graph-Based Context Modeling (Accepted by AAAI'2024)☆59Updated last year
- A 6-million Audio-Caption Paired Dataset Built with a LLMs and ALMs-based Automatic Pipeline☆194Updated last year
- Dataset and baseline code for the VocalSound dataset (ICASSP2022).☆157Updated 3 years ago
- Official Pytorch implementation of "Large Language Models are Strong Audio-Visual Speech Recognition Learners" [ICASSP 2025] and "Mitigat…☆55Updated last week
- ☆59Updated 2 years ago
- Audio Captioning datasets for PyTorch.☆125Updated 6 months ago
- A repo containing download guidance and corresponding scripts of the VoxBlink dataset.☆28Updated last year
- Unified Speech Language Model for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"(ICLR 2024)☆151Updated 2 years ago
- An official implementation of "UnitSpeech: Speaker-adaptive Speech Synthesis with Untranscribed Data"☆137Updated 2 years ago
- The open source code for LLM-Codec☆146Updated last year
- Implementation of BEST-RQ - a model for self-supervised learning of speech signals using a random projection quantizer, in Pytorch.☆132Updated 2 years ago
- Official Repository For VoxBlink2☆85Updated last year
- BLSP-Emo: Towards Empathetic Large Speech-Language Models☆56Updated last year
- The VoxTube dataset official repository☆71Updated last year
- The official repository of SpeechCraft dataset, a large-scale expressive bilingual speech dataset with natural language descriptions.☆179Updated 9 months ago
- [Interspeech 2023] Intelligible Lip-to-Speech Synthesis with Speech Units☆47Updated last year