ictnlp / ComSpeech
Code for ACL 2024 main conference paper "Can We Achieve High-quality Direct Speech-to-Speech Translation Without Parallel Speech Data?".
☆23Updated 4 months ago
Related projects ⓘ
Alternatives and complementary repositories for ComSpeech
- A fast speech-to-speech & speech-to-text translation model that supports simultaneous decoding and offers 28× speedup.☆60Updated 2 weeks ago
- Official release of StyleTalk dataset.☆57Updated 4 months ago
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆41Updated last week
- ☆34Updated 6 months ago
- [ACL 2024] Generative Pre-Trained Speech Language Model with Efficient Hierarchical Transformer☆33Updated last week
- SLMTokBench for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"☆33Updated last year
- Temporary anonymous version☆22Updated 7 months ago
- Code and pretrained models for "DUB: Discrete Unit Back-translation for Speech Translation" (ACL 2023 Findings)☆26Updated last year
- BLSP-Emo: Towards Empathetic Large Speech-Language Models☆36Updated 5 months ago
- Official Code for ParrotTTS☆41Updated 3 weeks ago
- ☆16Updated 6 months ago
- X-E-Speech: Joint Training Framework of Non-Autoregressive Cross-lingual Emotional Text-to-Speech and Voice Conversion☆65Updated 7 months ago
- Pushing the Limits of Zero-shot End-to-End Speech Translation☆21Updated 2 months ago
- Zero-Shot Emotion Style Transfer☆37Updated 7 months ago
- ☆27Updated 11 months ago
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆38Updated last week
- Implementation of Acoustic BPE (Shen et al., 2024), extended for RVQ-based Neural Audio Codecs☆46Updated last month
- The official repository of SpeechCraft dataset, a large-scale expressive bilingual speech dataset with natural language descriptions.☆49Updated last month
- All generative model in one for better TTS model☆66Updated 2 months ago
- Official repository for NAST: Noise Aware Speech Tokenization for Speech Language Models (Interspeech 2024) https://arxiv.org/abs/2406.11…☆42Updated 4 months ago
- ConMamba for Automatic Speech Recognition☆44Updated 2 months ago
- Implementation of the model "AudioFlamingo" from the paper: "Audio Flamingo: A Novel Audio Language Model with Few-Shot Learning and Dial…☆39Updated this week
- ☆21Updated last week
- ☆25Updated 3 months ago
- Unofficial pytorch reproduction for the paper "Utilizing Neural Transducers for Two-Stage Text-to-Speech via Semantic Token Prediction" (…☆58Updated 7 months ago
- ☆26Updated last year
- [ACL 2024] This is the Pytorch code for our paper "StyleDubber: Towards Multi-Scale Style Learning for Movie Dubbing"☆47Updated 2 weeks ago
- VoxInstruct: Expressive Human Instruction-to-Speech Generation with Unified Multilingual Codec Language Modelling☆19Updated 2 months ago
- FCTalker: Fine and Coarse Grained Context Modeling for Expressive Conversational Speech Synthesis (Accepted by ISCSLP'2024)☆22Updated 8 months ago