choijeongsoo / utut
[TASLP 2024] Textless Unit-to-Unit training for Many-to-Many Multilingual Speech-to-Speech Translation
☆30Updated 8 months ago
Alternatives and similar repositories for utut
Users that are interested in utut are comparing it to the libraries listed below
Sorting:
- We propose C2SER, a novel audio-language model designed to enhance the stability and accuracy of speech emotion recognition through conte…☆30Updated 2 months ago
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆58Updated 6 months ago
- Towards a general language-audio model for computational paralinguistic tasks☆11Updated 5 months ago
- 《SpeechPrompt v2: Prompt Tuning for Speech Classification Tasks》Speech processing with prompting paradigm☆81Updated last year
- The open source code for LLM-Codec☆133Updated 9 months ago
- EMO-SUPERB submission☆42Updated 8 months ago
- VoxInstruct: Expressive Human Instruction-to-Speech Generation with Unified Multilingual Codec Language Modelling☆76Updated 6 months ago
- Multi-Task Speech classification of accent and gender of an english speaker on Mozilla's common voice dataset☆26Updated last month
- ☆43Updated 2 years ago
- Emotion Rendering for Conversational Speech Synthesis with Heterogeneous Graph-Based Context Modeling (Accepted by AAAI'2024)☆56Updated 10 months ago
- Unofficial pytorch reproduction for the paper "Utilizing Neural Transducers for Two-Stage Text-to-Speech via Semantic Token Prediction" (…☆61Updated last year
- Survey on speech generation work.☆19Updated last year
- Official implementation for Fast-HuBERT: An Efficient Training Framework for Self-Supervised Speech Representation Learning☆90Updated 5 months ago
- ☆71Updated last year
- A toolkit dedicate for speech evaluation.☆19Updated 7 months ago
- [CVPR 2024] AV2AV: Direct Audio-Visual Speech to Audio-Visual Speech Translation with Unified Audio-Visual Speech Representation☆35Updated 8 months ago
- Code and pretrained models for "DUB: Discrete Unit Back-translation for Speech Translation" (ACL 2023 Findings)☆29Updated last year
- Source code and speech samples for the DSU-AVO paper accepted to INTERSPEECH 2023☆12Updated last year
- ☆51Updated 6 months ago
- This is the official train-dev-test release of the Interspeech2024 Discrete Speech Representation Challenge.☆32Updated last year
- ☆30Updated 5 months ago
- This repository presents an evaluation framework for speech-to-speech (S2S) models, following the methodology described in the EmphAsses …☆21Updated last year
- [NeurIPS 2024] SD-Eval: A Benchmark Dataset for Spoken Dialogue Understanding Beyond Words☆49Updated 10 months ago
- UMETTS: A Unified Framework for Emotional Text-to-Speech Synthesis with Multimodal Prompts☆28Updated 4 months ago
- A benchmark to evaluate full-duplex spoken dialogue models on pause handling, backchanneling, turn-taking, and user interruptions.☆29Updated this week
- ☆63Updated last year
- [AAAI 2024] CTX-txt2vec, the acoustic model in UniCATS☆64Updated 6 months ago
- Retrieval-Augmented MOS Prediction with Prior Knowledge Integration☆25Updated last month
- The implementation of paper "SpeechTripleNet: End-to-End Disentangled Speech Representation Learning for Content, Timbre and Prosody"☆32Updated last year
- ☆9Updated last month