ictnlp / ComSpeech
Code for ACL 2024 main conference paper "Can We Achieve High-quality Direct Speech-to-Speech Translation Without Parallel Speech Data?".
☆23Updated 4 months ago
Related projects ⓘ
Alternatives and complementary repositories for ComSpeech
- A fast speech-to-speech & speech-to-text translation model that supports simultaneous decoding and offers 28× speedup.☆60Updated 3 weeks ago
- [ACL 2024] Generative Pre-Trained Speech Language Model with Efficient Hierarchical Transformer☆37Updated 2 weeks ago
- ☆34Updated 7 months ago
- Official release of StyleTalk dataset.☆57Updated 4 months ago
- LLaST: Improved End-to-end Speech Translation System Leveraged by Large Language Models☆20Updated 3 months ago
- VoiceBench: Benchmarking LLM-Based Voice Assistants☆32Updated this week
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆56Updated 2 weeks ago
- Implementation of Google's USM speech model in Pytorch☆25Updated last week
- List of direct speech-to-speech translation papers.☆31Updated last year
- BLSP-Emo: Towards Empathetic Large Speech-Language Models☆39Updated 5 months ago
- ConMamba for Automatic Speech Recognition☆44Updated 3 months ago
- Official Code for ParrotTTS☆42Updated last month
- X-E-Speech: Joint Training Framework of Non-Autoregressive Cross-lingual Emotional Text-to-Speech and Voice Conversion☆70Updated 7 months ago
- VoxInstruct: Expressive Human Instruction-to-Speech Generation with Unified Multilingual Codec Language Modelling☆41Updated last week
- ☆26Updated last year
- SLMTokBench for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"☆33Updated last year
- Official repo for CoVoMix: Advancing Zero-Shot Speech Generation for Human-like Multi-talker Conversations☆32Updated last month
- FCTalker: Fine and Coarse Grained Context Modeling for Expressive Conversational Speech Synthesis (Accepted by ISCSLP'2024)☆22Updated 8 months ago
- Temporary anonymous version☆22Updated 8 months ago
- The official repository of SpeechCraft dataset, a large-scale expressive bilingual speech dataset with natural language descriptions.☆51Updated last month
- [Findings of NAACL 2024] Source code of paper CM-TTS: Enhancing Real Time Text-to-Speech Synthesis Efficiency through Weighted Samplers a…☆62Updated 7 months ago
- Code and pretrained models for "DUB: Discrete Unit Back-translation for Speech Translation" (ACL 2023 Findings)☆26Updated last year
- ☆21Updated 4 months ago
- Unofficial pytorch reproduction for the paper "Utilizing Neural Transducers for Two-Stage Text-to-Speech via Semantic Token Prediction" (…☆58Updated 7 months ago
- Implementation of the model "AudioFlamingo" from the paper: "Audio Flamingo: A Novel Audio Language Model with Few-Shot Learning and Dial…☆39Updated last week
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆42Updated 2 weeks ago
- [ACMMM'2024] Generative Expressive Conversational Speech Synthesis☆28Updated 3 weeks ago
- Unified Speech Language Model for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"(ICLR 2024)☆139Updated last year
- ☆32Updated 2 months ago