0nutation / DUB
Code and pretrained models for "DUB: Discrete Unit Back-translation for Speech Translation" (ACL 2023 Findings)
☆26Updated last year
Related projects ⓘ
Alternatives and complementary repositories for DUB
- SLMTokBench for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"☆33Updated last year
- Official release of StyleTalk dataset.☆57Updated 4 months ago
- The open source code for LLM-Codec☆114Updated 3 months ago
- Implementation of CoBERT: Self-Supervised Speech Representation Learning Through Code Representation Learning☆46Updated last year
- 《SpeechGen: Unlocking the Generative Power of Speech Language Models with Prompts》☆74Updated last year
- ☆26Updated last year
- [ACL 2024] Generative Pre-Trained Speech Language Model with Efficient Hierarchical Transformer☆37Updated 2 weeks ago
- BLSP-Emo: Towards Empathetic Large Speech-Language Models☆39Updated 5 months ago
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆42Updated 2 weeks ago
- [NeurIPS 2024] SD-Eval: A Benchmark Dataset for Spoken Dialogue Understanding Beyond Words☆42Updated 4 months ago
- Unified Speech Language Model for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"(ICLR 2024)☆139Updated last year
- Unofficial pytorch reproduction for the paper "Utilizing Neural Transducers for Two-Stage Text-to-Speech via Semantic Token Prediction" (…☆58Updated 7 months ago
- VoxInstruct: Expressive Human Instruction-to-Speech Generation with Unified Multilingual Codec Language Modelling☆41Updated last week
- Implementation of Acoustic BPE (Shen et al., 2024), extended for RVQ-based Neural Audio Codecs☆47Updated last month
- LLaST: Improved End-to-end Speech Translation System Leveraged by Large Language Models☆20Updated 3 months ago
- An unofficial PyTorch implementation of Mix-Phoneme-Bert☆39Updated last year
- Speech samples and code of BEdit-TTS☆32Updated last year
- PyTorch Implementation of ViT-TTS (EMNLP'23)☆10Updated last year
- All generative model in one for better TTS model☆66Updated 2 months ago
- ☆21Updated 4 months ago
- Official repo for CoVoMix: Advancing Zero-Shot Speech Generation for Human-like Multi-talker Conversations☆32Updated last month
- 《SpeechPrompt v2: Prompt Tuning for Speech Classification Tasks》Speech processing with prompting paradigm☆81Updated last year
- FCTalker: Fine and Coarse Grained Context Modeling for Expressive Conversational Speech Synthesis (Accepted by ISCSLP'2024)☆22Updated 8 months ago
- ☆62Updated 10 months ago
- AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension☆56Updated 3 months ago
- ☆31Updated 2 weeks ago
- ☆31Updated last year
- A fast speech-to-speech & speech-to-text translation model that supports simultaneous decoding and offers 28× speedup.☆60Updated 3 weeks ago
- multilingual speech aligner☆72Updated last year
- ☆34Updated 7 months ago