liamdugan / speech-to-speech
Code for the INTERSPEECH 2023 paper "Learning When to Speak: Latency and Quality Trade-offs for Simultaneous Speech-to-Speech Translation with Offline Models"
☆31Updated 3 months ago
Alternatives and similar repositories for speech-to-speech:
Users that are interested in speech-to-speech are comparing it to the libraries listed below
- SLMTokBench for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"☆35Updated last year
- LLaST: Improved End-to-end Speech Translation System Leveraged by Large Language Models☆25Updated 8 months ago
- Official release of StyleTalk dataset.☆62Updated 9 months ago
- A fast speech-to-speech & speech-to-text translation model that supports simultaneous decoding and offers 28× speedup.☆68Updated 6 months ago
- Code for ACL 2024 main conference paper "Can We Achieve High-quality Direct Speech-to-Speech Translation Without Parallel Speech Data?".☆24Updated 9 months ago
- [ACL 2024] Generative Pre-Trained Speech Language Model with Efficient Hierarchical Transformer☆52Updated 5 months ago
- ☆22Updated 10 months ago
- Code and pretrained models for "DUB: Discrete Unit Back-translation for Speech Translation" (ACL 2023 Findings)☆29Updated last year
- [ICASSP 2024] KNN-CTC: Enhancing ASR via Retrieval of CTC Pseudo Labels☆35Updated last year
- ☆21Updated 8 months ago
- Official code for Interspeech 2023 paper "Self-supervised Fine-tuning for Improved Content Representations by Speaker-invariant Clusterin…☆52Updated last year
- BLSP-Emo: Towards Empathetic Large Speech-Language Models☆43Updated 10 months ago
- The open source code for LLM-Codec☆133Updated 8 months ago
- Speaker-aware CTC (SACTC) for multi-talker overlapped speech recognition.☆16Updated 3 weeks ago
- ☆14Updated 2 years ago
- ☆35Updated last year
- Repository containing the open source code of works published at the FBK MT unit.☆43Updated last week
- Word Discovery in Visually Grounded, Self-Supervised Speech Models☆26Updated last year
- Implementation of Google's USM speech model in Pytorch☆31Updated 2 weeks ago
- Official implementation for Fast-HuBERT: An Efficient Training Framework for Self-Supervised Speech Representation Learning☆86Updated 5 months ago
- Implementation of CoBERT: Self-Supervised Speech Representation Learning Through Code Representation Learning☆46Updated last year
- A toolkit to calculate speech audio quality. Not affiliated with the original authors☆50Updated 8 months ago
- Official Code for SyllableLM: Learning Coarse Semantic Units for Speech Language Models☆51Updated last month
- List of direct speech-to-speech translation papers.☆37Updated 2 years ago
- ☆13Updated last year
- A Massive Multilingual Multi-speaker Speech Corpus for Scaling Indian TTS☆38Updated 4 months ago
- Collection of scripts from mHuBERT-147.☆24Updated 5 months ago
- Automatic speech annotator processing speech with voice activaty detection, overlapping speech detection, speaker diarization and automat…☆32Updated 10 months ago
- ☆37Updated 7 months ago
- [NeurIPS 2024] SD-Eval: A Benchmark Dataset for Spoken Dialogue Understanding Beyond Words☆49Updated 10 months ago