facebookresearch / MMCSG
This repository contains the baseline system for CHiME-8 MMCSG challenge focusing on transcribing both sides of a conversation where one participant is wearing smart glasses equipped with a microphone array and camera.
☆28Updated 8 months ago
Related projects ⓘ
Alternatives and complementary repositories for MMCSG
- Code of the paper "Low-Latency Speech Separation Guided Diarization for Telephone Conversations"☆13Updated last year
- (Interspeech 2023 & ICASSP 2024) Official repository for ARMHuBERT and STaRHuBERT☆38Updated 2 months ago
- Balanced Error Rate for Speaker Diarization☆25Updated last year
- Official Code for SyllableLM: Learning Coarse Semantic Units for Speech Language Models☆35Updated last month
- CDER (Conversational Diarization Error Rate) Scoring Tool☆16Updated 2 years ago
- A toolkit dedicate for speech evaluation.☆18Updated last month
- Multipurpose Multi Speaker Mixture Signal Generator☆43Updated last month
- ☆26Updated last year
- PyTorch implementation of Continuous Speech Separation☆13Updated 2 years ago
- Official code for Interspeech 2023 paper "Self-supervised Fine-tuning for Improved Content Representations by Speaker-invariant Clusterin…☆44Updated last year
- ☆36Updated 2 years ago
- Typing to Listen at the Cocktail Party: Text-Guided Target Speaker Extraction (LLM-TSE)☆32Updated last year
- ☆26Updated last year
- ☆21Updated 4 months ago
- Python scripts to create noisy and reverberant 2-speaker mixture audio with Libri-Light and WHAM☆15Updated 2 weeks ago
- Official Implementation of TSELM: Target speaker extraction using discrete tokens and language models☆20Updated 2 months ago
- A collection of papers related to speech model compression☆24Updated last year
- Self-Supervised Speech Pre-training and Representation Learning Toolkit.☆8Updated 2 years ago
- Implementation of the paper "Self-supervised Learning with Random-projection Quantizer for Speech Recognition" in Pytorch.☆59Updated last year
- SRTNet☆24Updated last year
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆42Updated 3 weeks ago
- A toolkit for researchers in the multimodal sound separation.☆16Updated last year
- wake-up word emotion recognition [APSIPA 2022]☆17Updated 2 years ago
- End-to-end diarization loss☆22Updated 3 years ago
- ConMamba for Automatic Speech Recognition☆44Updated 3 months ago
- Implementation of CoBERT: Self-Supervised Speech Representation Learning Through Code Representation Learning☆46Updated last year
- TS-SEP: Joint Diarization and Separation Conditioned on Estimated Speaker Embeddings☆17Updated last month
- A Pytorch implementation of the paper : SpecAugment++: A Hidden Space Data Augmentation Method for Acoustic Scene Classification☆31Updated 3 years ago
- Learning and controlling the source-filter representation of speech with a variational autoencoder☆45Updated last year
- The implementation for "Empowering Whisper as a Joint Multi-Talker and Target-Talker Speech Recognition System".☆18Updated 2 months ago