sanchit-gandhi / seq2seq-speech
Repository for fine-tuning Transformers 🤗 based seq2seq speech models in JAX/Flax.
☆34Updated last year
Related projects: ⓘ
- Final training script from HuggingFace Whisper Fine tuning event - to get best results on finetuned model.☆12Updated last year
- Speech in Flax/JAX☆15Updated 2 years ago
- ☆48Updated last month
- This app is intended to automatically create a corpus for ASR systems using pseudo-labeling.☆27Updated 7 months ago
- Audio tokenization, in the fastest way possible!☆45Updated 3 weeks ago
- ☆38Updated last year
- An espeak-compatible, permissively-licensed IPA phonemizer (G2P) based on DeepPhonemizer. Usable as a drop-in replacement for espeak's GP…☆74Updated 2 months ago
- ☆74Updated 2 years ago
- Collection of scripts from mHuBERT-147.☆21Updated 2 months ago
- A PyTorch Lightning Callback for pushing models to the Hugging Face Hub 🤗⚡️☆35Updated 2 years ago
- Tutorial to pretrain & fine-tune a 🤗 Flax T5 model on a TPUv3-8 with GCP☆58Updated 2 years ago
- A collection of scripts to preprocess ASR datasets and finetune language-specific Wav2Vec2 XLSR models☆31Updated 3 years ago
- asr2k☆48Updated 3 months ago
- ☆18Updated last year
- Transcribing Speech with Multinomial Diffusion, training code and models.☆74Updated 11 months ago
- ☆84Updated 5 months ago
- Official code for Wav2Seq☆95Updated 2 years ago
- ☆56Updated last year
- Experiments with generating opensource language model assistants☆97Updated last year
- Prabhupadavani: A Code-mixed Speech Translation Data for 25 languages☆13Updated last year
- Zero-shot Audio Classification using Whisper☆74Updated last year
- A TTS model that makes a speaker speak new languages☆73Updated 3 months ago
- ☆11Updated 2 years ago
- Promting Whisper for Audio-Visual Speech Recognition, Code-Switched Speech Recognition, and Zero-Shot Speech Translation☆132Updated 8 months ago
- ☆61Updated last month
- SpeechGLUE is a speech version of the GLUE benchmark, driven by text-to-speech.☆13Updated last year
- Explore different way to mix speech model(wav2vec2, hubert) and nlp model(BART,T5,GPT) together☆42Updated last year
- Various transformers for FSDP research☆31Updated last year
- 56 language, 1 model Multilingual ASR☆23Updated 3 years ago
- Transcribing audio files using Hugging Face's implementation of Wav2Vec2 + "chain-linking" NLP tasks to combine speech-to-text with downs…☆31Updated 3 years ago