mtkresearch / TASTE-SpokenLMLinks
A method that directly addresses the modality gap by aligning speech token with the corresponding text transcription during the tokenization stage.
☆84Updated last month
Alternatives and similar repositories for TASTE-SpokenLM
Users that are interested in TASTE-SpokenLM are comparing it to the libraries listed below
Sorting:
- Code for DeSTA2.5-Audio☆92Updated this week
- Code and model for ICASSP 2025 Paper "Developing Instruction-Following Speech Language Model Without Speech Instruction-Tuning Data"☆106Updated 3 weeks ago
- Official release of StyleTalk dataset.☆67Updated last year
- Streamable Text-to-Speech model using a language modeling approach, without vector quantization☆96Updated 2 months ago
- Official implementation of MelHuBERT☆66Updated 9 months ago
- WavReward: Spoken Dialogue Models With Generalist Reward Evaluators☆50Updated 2 months ago
- 《SpeechGen: Unlocking the Generative Power of Speech Language Models with Prompts》☆74Updated 2 years ago
- A benchmark to evaluate full-duplex spoken dialogue models on pause handling, backchanneling, turn-taking, and user interruptions.☆54Updated last month
- Official Code for SyllableLM: Learning Coarse Semantic Units for Speech Language Models☆57Updated last month
- [ACL 2024] Generative Pre-Trained Speech Language Model with Efficient Hierarchical Transformer☆60Updated 9 months ago
- Unified Speech Language Model for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"(ICLR 2024)☆148Updated last year
- Codebase for 'Scaling Rich Style-Prompted Text-to-Speech Datasets'☆127Updated 4 months ago
- ☆69Updated 11 months ago
- A trainer for SNAC (Multi-Scale Neural Audio Codec) has replaced the decoder with Vocos.☆58Updated 9 months ago
- Official code for Interspeech 2023 paper "Self-supervised Fine-tuning for Improved Content Representations by Speaker-invariant Clusterin…☆56Updated 2 years ago
- Implementation of Acoustic BPE (Shen et al., 2024), extended for RVQ-based Neural Audio Codecs☆66Updated 2 weeks ago
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆61Updated 9 months ago
- The open source code for LLM-Codec☆136Updated 11 months ago
- All generative model in one for better TTS model☆71Updated 10 months ago
- Official code for "F5R-TTS: Improving Flow-Matching based Text-to-Speech with Group Relative Policy Optimization"☆107Updated 2 months ago
- [NeurIPS 2024] SD-Eval: A Benchmark Dataset for Spoken Dialogue Understanding Beyond Words☆50Updated last year
- ☆41Updated 10 months ago
- An automatic prosodic boundary annotation tool for Text-to-Speech Synthesis (TTS).☆49Updated last year
- ☆78Updated 3 weeks ago
- Models and code for RepCodec: A Speech Representation Codec for Speech Tokenization☆180Updated last year
- Official implementation for Fast-HuBERT: An Efficient Training Framework for Self-Supervised Speech Representation Learning☆94Updated 8 months ago
- Benchmark for evaluating TTS models on complex prosodic, expressiveness, and linguistic challenges.☆128Updated last week
- LibriSpeech-Long is a benchmark dataset for long-form speech generation and processing. Released as part of "Long-Form Speech Generation …☆79Updated 7 months ago
- The TTSDS benchmark evaluates synthetic speech quality by considering prosody, speaker identity, and intelligibility, comparing these fac…☆50Updated 3 weeks ago
- Evaluation Protocol for Large-Scale Zero-Shot TTS Literature☆82Updated 4 months ago