zhenye234 / xcodec
Codec Does Matter: Exploring the Semantic Shortcoming of Codec for Audio Language Model
☆104Updated last month
Related projects ⓘ
Alternatives and complementary repositories for xcodec
- The open source code for SimpleSpeech series☆111Updated last month
- Models and code for RepCodec: A Speech Representation Codec for Speech Tokenization☆160Updated 4 months ago
- The open source code for LLM-Codec☆114Updated 3 months ago
- UTokyo-SaruLab MOS Prediction System☆94Updated last week
- LibriTTS-P: A Corpus with Speaking Style and Speaker Identity Prompts for Text-to-Speech and Style Captioning☆114Updated 5 months ago
- [AAAI 2024] Code for CTX-vec2wav in UniCATS☆122Updated 5 months ago
- Real-time Speech-Text Foundation Model Toolkit (wip)☆122Updated last month
- Unified Speech Language Model for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"(ICLR 2024)☆139Updated last year
- Official implementation of the paper "BigCodec: Pushing the Limits of Low-Bitrate Neural Speech Codec"☆82Updated 2 months ago
- ☆55Updated 11 months ago
- Evaluation Protocol for Large-Scale Zero-Shot TTS Literature☆66Updated last month
- Reference-aware automatic speech evaluation toolkit☆109Updated 9 months ago
- ☆104Updated last month
- ☆62Updated 10 months ago
- [InterSpeech 24] FreeV: Free Lunch For Vocoders Through Pseudo Inversed Mel Filter☆78Updated 4 months ago
- [AAAI 2024] CTX-txt2vec, the acoustic model in UniCATS☆63Updated this week
- Source for the Interspeech 2024 Paper "Scaling up masked audio encoder learning for general audio classification"☆44Updated 2 months ago
- Ultra-low bitrate neural audio codec (0.31~1.40 kbps) with a better semantic in the latent space.☆150Updated 2 months ago
- Robust Singing Voice Transcription and MIDI Extraction☆56Updated 3 months ago
- ☆40Updated 5 months ago
- [ICASSP 2024] StoryTTS: A Highly Expressive Text-to-Speech Dataset with Rich Textual Expressiveness Annotations☆135Updated 6 months ago
- An automatic prosodic boundary annotation tool for Text-to-Speech Synthesis (TTS).☆48Updated 5 months ago
- A 6-million Audio-Caption Paired Dataset Built with a LLMs and ALMs-based Automatic Pipeline☆66Updated 2 weeks ago
- ☆57Updated 2 months ago
- The official source code of UniAudio☆83Updated 7 months ago
- Unofficial pytorch reproduction for the paper "Utilizing Neural Transducers for Two-Stage Text-to-Speech via Semantic Token Prediction" (…☆58Updated 7 months ago
- ZMM-TTS: Zero-shot Multilingual and Multispeaker Speech Synthesis Conditioned on Self-supervised Discrete Speech Representations☆126Updated 8 months ago
- ☆62Updated last year
- [NeurIPS 2024] SD-Eval: A Benchmark Dataset for Spoken Dialogue Understanding Beyond Words☆42Updated 4 months ago
- ☆51Updated last year