facebookresearch / SONAR
SONAR, a new multilingual and multimodal fixed-size sentence embedding space, with a full suite of speech and text encoders and decoders.
☆309Updated last week
Related projects: ⓘ
- ☆241Updated 3 months ago
- NeMo text processing for ASR and TTS☆266Updated this week
- Promting Whisper for Audio-Visual Speech Recognition, Code-Switched Speech Recognition, and Zero-Shot Speech Translation☆132Updated 8 months ago
- ☆272Updated 2 weeks ago
- Finetune VITS and MMS using HuggingFace's tools☆110Updated 5 months ago
- ☆342Updated 6 months ago
- EMNLP 23 - Integrating Whisper Encoder to LLaMA Decoder for Generative ASR Error Correction☆223Updated 4 months ago
- MuAViC: A Multilingual Audio-Visual Corpus for Robust Speech Recognition and Robust Speech-to-Text Translation☆353Updated last year
- Code and Pretrained Models for Interspeech 2023 Paper "Whisper-AT: Noise-Robust Automatic Speech Recognizers are Also Strong Audio Event …☆312Updated 6 months ago
- Multi-Scale Neural Audio Codec (SNAC) compresses audio into discrete codes at a low bitrate☆348Updated last week
- ☆244Updated 6 months ago
- ☆48Updated last month
- This is the code for the SpeechTokenizer presented in the SpeechTokenizer: Unified Speech Tokenizer for Speech Language Models. Samples a…☆412Updated 3 months ago
- The Open Source Code of UniAudio☆509Updated last month
- Code, Dataset, and Pretrained Models for Audio and Speech Large Language Model "Listen, Think, and Understand".☆360Updated 4 months ago
- An Audio Language model for Audio Tasks☆281Updated 5 months ago
- CVSS: A Massively Multilingual Speech-to-Speech Translation Corpus☆178Updated 2 years ago
- Fine-tune and evaluate Whisper models for Automatic Speech Recognition (ASR) on custom datasets or datasets from huggingface.☆219Updated last year
- The Hugging Face Course on Transformers for Audio☆313Updated last month
- ☆431Updated 2 months ago
- PyTorch implementation of Audio Flamingo: A Novel Audio Language Model with Few-Shot Learning and Dialogue Abilities.☆169Updated 3 weeks ago
- Multilingual G2P in 100 languages☆274Updated last year
- Implementation of E2-TTS, "Embarrassingly Easy Fully Non-Autoregressive Zero-Shot TTS", in Pytorch☆228Updated last week
- Library for Textless Spoken Language Processing☆521Updated last year
- Implementation of Voicebox, new SOTA Text-to-speech network from MetaAI, in Pytorch☆592Updated 7 months ago
- Speech, Language, Audio, Music Processing with Large Language Model☆495Updated 3 weeks ago
- Implementation of Spear-TTS - multi-speaker text-to-speech attention network, in Pytorch☆250Updated 10 months ago
- PyTorch code implementation of EfficientSpeech - to be presented at ICASSP2023.☆149Updated 6 months ago
- [NeurIPS'22] Squeezeformer: An Efficient Transformer for Automatic Speech Recognition☆245Updated last year
- ☆84Updated 5 months ago