0nutation / DUB
Code and pretrained models for "DUB: Discrete Unit Back-translation for Speech Translation" (ACL 2023 Findings)
☆28Updated last year
Alternatives and similar repositories for DUB:
Users that are interested in DUB are comparing it to the libraries listed below
- SLMTokBench for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"☆33Updated last year
- Official release of StyleTalk dataset.☆62Updated 8 months ago
- [ACL 2024] Generative Pre-Trained Speech Language Model with Efficient Hierarchical Transformer☆52Updated 4 months ago
- [NeurIPS 2024] SD-Eval: A Benchmark Dataset for Spoken Dialogue Understanding Beyond Words☆48Updated 9 months ago
- BLSP-Emo: Towards Empathetic Large Speech-Language Models☆43Updated 9 months ago
- Implementation of CoBERT: Self-Supervised Speech Representation Learning Through Code Representation Learning☆46Updated last year
- ☆25Updated 2 years ago
- The open source code for LLM-Codec☆132Updated 7 months ago
- ☆35Updated 7 months ago
- 《SpeechGen: Unlocking the Generative Power of Speech Language Models with Prompts》☆74Updated last year
- LLaST: Improved End-to-end Speech Translation System Leveraged by Large Language Models☆25Updated 7 months ago
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆55Updated 4 months ago
- FCTalker: Fine and Coarse Grained Context Modeling for Expressive Conversational Speech Synthesis (Accepted by ISCSLP'2024)☆23Updated last year
- [ICASSP 2024] KNN-CTC: Enhancing ASR via Retrieval of CTC Pseudo Labels☆34Updated last year
- 《SpeechPrompt v2: Prompt Tuning for Speech Classification Tasks》Speech processing with prompting paradigm☆81Updated last year
- Unified Speech Language Model for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"(ICLR 2024)☆138Updated last year
- [TASLP 2024] Textless Unit-to-Unit training for Many-to-Many Multilingual Speech-to-Speech Translation☆29Updated 6 months ago
- Code for ACL 2023 main conference paper "Back Translation for Speech-to-text Translation Without Transcripts".☆13Updated last year
- [AAAI 2024] CTX-txt2vec, the acoustic model in UniCATS☆64Updated 4 months ago
- VoxInstruct: Expressive Human Instruction-to-Speech Generation with Unified Multilingual Codec Language Modelling☆67Updated 4 months ago
- ☆28Updated 8 months ago
- ☆63Updated last year
- An unofficial PyTorch implementation of Mix-Phoneme-Bert☆39Updated last year
- Unofficial pytorch reproduction for the paper "Utilizing Neural Transducers for Two-Stage Text-to-Speech via Semantic Token Prediction" (…☆61Updated 11 months ago
- BLSP: Bootstrapping Langauge-Speech Pre-training via Behavior Alignment of Continuation Writing☆51Updated last year
- Implementation of Acoustic BPE (Shen et al., 2024), extended for RVQ-based Neural Audio Codecs☆54Updated last week
- A low-bitrate single-codebook 16 kHz speech codec based on focal modulation☆79Updated last month
- An automatic prosodic boundary annotation tool for Text-to-Speech Synthesis (TTS).☆48Updated 9 months ago
- Official implementation for Fast-HuBERT: An Efficient Training Framework for Self-Supervised Speech Representation Learning☆86Updated 4 months ago
- The official repository of SpeechCraft dataset, a large-scale expressive bilingual speech dataset with natural language descriptions.☆110Updated 2 months ago