facebookresearch / muavic
MuAViC: A Multilingual Audio-Visual Corpus for Robust Speech Recognition and Robust Speech-to-Text Translation
☆381Updated last year
Alternatives and similar repositories for muavic:
Users that are interested in muavic are comparing it to the libraries listed below
- Implementation of Spear-TTS - multi-speaker text-to-speech attention network, in Pytorch☆268Updated last year
- This is the code for the SpeechTokenizer presented in the SpeechTokenizer: Unified Speech Tokenizer for Speech Language Models. Samples a…☆530Updated 9 months ago
- An Audio Language model for Audio Tasks☆301Updated 10 months ago
- The Open Source Code of UniAudio☆546Updated 7 months ago
- ☆253Updated 11 months ago
- ☆351Updated 6 months ago
- A self-supervised learning framework for audio-visual speech☆882Updated last year
- Implementation of Voicebox, new SOTA Text-to-speech network from MetaAI, in Pytorch☆642Updated 5 months ago
- EMNLP 23 - Integrating Whisper Encoder to LLaMA Decoder for Generative ASR Error Correction☆249Updated 9 months ago
- ☆253Updated last year
- Code, Dataset, and Pretrained Models for Audio and Speech Large Language Model "Listen, Think, and Understand".☆416Updated 10 months ago
- Next-generation TTS model using flow-matching and DiT, inspired by Stable Diffusion 3☆393Updated 6 months ago
- Official Implementation of StyleTTS☆425Updated 2 months ago
- The reproduced code for Google's SoundStorm☆263Updated last year
- Implementation of Meta-Voicebox : The first generative AI model for speech to generalize across tasks with state-of-the-art performance.☆576Updated last year
- unofficial vits2-TTS implementation in pytorch☆510Updated 11 months ago
- [Interspeech 2024] Whisper-Flamingo: Integrating Visual Features into Whisper for Audio-Visual Speech Recognition and Translation☆144Updated last month
- ☆275Updated 9 months ago
- WavJourney: Compositional Audio Creation with LLMs☆531Updated last year
- A fully working pytorch implementation of NaturalSpeech (Tan et al., 2022)☆474Updated last year
- An official reimplementation of the method described in the INTERSPEECH 2021 paper - Speech Resynthesis from Discrete Disentangled Self-S…☆401Updated last year
- VITS2: Improving Quality and Efficiency of Single-Stage Text-to-Speech with Adversarial Learning and Architecture Design☆541Updated last year
- Promting Whisper for Audio-Visual Speech Recognition, Code-Switched Speech Recognition, and Zero-Shot Speech Translation☆143Updated last year
- Multi-Scale Neural Audio Codec (SNAC) compresses audio into discrete codes at a low bitrate☆493Updated 3 months ago
- PyTorch implementation of Audio Flamingo 2: An Audio-Language Model with Long-Audio Understanding and Expert Reasoning Abilities.☆266Updated this week
- 🐤 Nix-TTS: Lightweight and End-to-end Text-to-Speech via Module-wise Distillation☆247Updated last year
- [ICASSP 2024] This is the official code for "VoiceFlow: Efficient Text-to-Speech with Rectified Flow Matching"☆334Updated 6 months ago
- [INTERSPEECH 2024] EmoBox: Multilingual Multi-corpus Speech Emotion Recognition Toolkit and Benchmark☆207Updated 8 months ago
- This is the main repository of open-sourced speech technology by Huawei Noah's Ark Lab.☆573Updated last year
- The deme page of InstructTTS☆156Updated last year