liamdugan / speech-to-speech
Code for the INTERSPEECH 2023 paper "Learning When to Speak: Latency and Quality Trade-offs for Simultaneous Speech-to-Speech Translation with Offline Models"
☆30Updated last month
Alternatives and similar repositories for speech-to-speech:
Users that are interested in speech-to-speech are comparing it to the libraries listed below
- A fast speech-to-speech & speech-to-text translation model that supports simultaneous decoding and offers 28× speedup.☆65Updated 4 months ago
- LLaST: Improved End-to-end Speech Translation System Leveraged by Large Language Models☆24Updated 6 months ago
- ☆43Updated last month
- The open source code for LLM-Codec☆128Updated 6 months ago
- Official release of StyleTalk dataset.☆61Updated 8 months ago
- Code and pretrained models for "DUB: Discrete Unit Back-translation for Speech Translation" (ACL 2023 Findings)☆28Updated last year
- SLMTokBench for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"☆33Updated last year
- BLSP-Emo: Towards Empathetic Large Speech-Language Models☆42Updated 8 months ago
- Code for ACL 2024 main conference paper "Can We Achieve High-quality Direct Speech-to-Speech Translation Without Parallel Speech Data?".☆24Updated 8 months ago
- ☆14Updated last year
- VoiceBench: Benchmarking LLM-Based Voice Assistants☆131Updated this week
- AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension☆80Updated 2 months ago
- AudioBench: A Universal Benchmark for Audio Large Language Models☆131Updated last week
- ☆25Updated 2 years ago
- Implementation of Acoustic BPE (Shen et al., 2024), extended for RVQ-based Neural Audio Codecs☆50Updated 5 months ago
- List of direct speech-to-speech translation papers.☆37Updated 2 years ago
- [ACL 2024] Generative Pre-Trained Speech Language Model with Efficient Hierarchical Transformer☆49Updated 4 months ago
- An official implementation of Style-Talker for Spoken Dialogue Generation☆17Updated last month
- Code for NeurIPS 2023 paper "DASpeech: Directed Acyclic Transformer for Fast and High-quality Speech-to-Speech Translation".☆61Updated 7 months ago
- Implementation of CoBERT: Self-Supervised Speech Representation Learning Through Code Representation Learning☆46Updated last year
- Implementation of Google's USM speech model in Pytorch☆29Updated last month
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆53Updated 4 months ago
- [NeurIPS 2024] SD-Eval: A Benchmark Dataset for Spoken Dialogue Understanding Beyond Words☆48Updated 8 months ago
- ☆35Updated 10 months ago
- BLSP: Bootstrapping Langauge-Speech Pre-training via Behavior Alignment of Continuation Writing☆50Updated 11 months ago
- Word Discovery in Visually Grounded, Self-Supervised Speech Models☆26Updated last year
- Official Code for ParrotTTS☆48Updated 4 months ago
- Collection of scripts from mHuBERT-147.☆24Updated 3 months ago
- Implementation of the model "AudioFlamingo" from the paper: "Audio Flamingo: A Novel Audio Language Model with Few-Shot Learning and Dial…☆40Updated last month