ictnlp / NAST-S2x
A fast speech-to-speech & speech-to-text translation model that supports simultaneous decoding and offers 28× speedup.
☆60Updated 3 weeks ago
Related projects ⓘ
Alternatives and complementary repositories for NAST-S2x
- Code for ACL 2024 main conference paper "Can We Achieve High-quality Direct Speech-to-Speech Translation Without Parallel Speech Data?".☆23Updated 4 months ago
- AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension☆56Updated 3 months ago
- BLSP-Emo: Towards Empathetic Large Speech-Language Models☆39Updated 5 months ago
- Unified Speech Language Model for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"(ICLR 2024)☆139Updated last year
- [ACL 2024] Generative Pre-Trained Speech Language Model with Efficient Hierarchical Transformer☆37Updated 2 weeks ago
- Official release of StyleTalk dataset.☆57Updated 4 months ago
- Code and pretrained models for "DUB: Discrete Unit Back-translation for Speech Translation" (ACL 2023 Findings)☆26Updated last year
- Official repo for CoVoMix: Advancing Zero-Shot Speech Generation for Human-like Multi-talker Conversations☆32Updated last month
- [NeurIPS 2024] SD-Eval: A Benchmark Dataset for Spoken Dialogue Understanding Beyond Words☆42Updated 4 months ago
- The open source code for LLM-Codec☆114Updated 3 months ago
- SLMTokBench for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"☆33Updated last year
- Code for NeurIPS 2023 paper "DASpeech: Directed Acyclic Transformer for Fast and High-quality Speech-to-Speech Translation".☆60Updated 4 months ago
- AudioBench: A Universal Benchmark for Audio Large Language Models☆93Updated last week
- ☆34Updated 7 months ago
- Official Code for ParrotTTS☆42Updated last month
- Paper, Code and Resources for Speech Language Model and End2End Speech Dialogue System.☆109Updated last week
- VoxInstruct: Expressive Human Instruction-to-Speech Generation with Unified Multilingual Codec Language Modelling☆41Updated last week
- Models and code for RepCodec: A Speech Representation Codec for Speech Tokenization☆160Updated 4 months ago
- All generative model in one for better TTS model☆66Updated 2 months ago
- List of direct speech-to-speech translation papers.☆31Updated last year
- Real-time Speech-Text Foundation Model Toolkit (wip)☆122Updated last month
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆56Updated 2 weeks ago
- The official repository of SpeechCraft dataset, a large-scale expressive bilingual speech dataset with natural language descriptions.☆51Updated last month
- Source for the Interspeech 2024 Paper "Scaling up masked audio encoder learning for general audio classification"☆44Updated 2 months ago
- ☆26Updated last year
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆42Updated 2 weeks ago
- VoiceBench: Benchmarking LLM-Based Voice Assistants☆32Updated this week
- Codec Does Matter: Exploring the Semantic Shortcoming of Codec for Audio Language Model☆104Updated last month
- [AAAI 2024] CTX-txt2vec, the acoustic model in UniCATS☆63Updated this week
- Unofficial pytorch reproduction for the paper "Utilizing Neural Transducers for Two-Stage Text-to-Speech via Semantic Token Prediction" (…☆58Updated 7 months ago