youngsheen / SimVQ
SimVQ: Addressing Representation Collapse in Vector Quantized Models with One Linear Layer
☆96Updated this week
Related projects ⓘ
Alternatives and complementary repositories for SimVQ
- The official repository of SpeechCraft dataset, a large-scale expressive bilingual speech dataset with natural language descriptions.☆49Updated last month
- Official repo for CoVoMix: Advancing Zero-Shot Speech Generation for Human-like Multi-talker Conversations☆30Updated last month
- The open source code for LLM-Codec☆114Updated 2 months ago
- [ACL 2024] Generative Pre-Trained Speech Language Model with Efficient Hierarchical Transformer☆34Updated last week
- [Official Implementation] Acoustic Autoregressive Modeling 🔥☆57Updated 2 months ago
- [NeurIPS 2024] SD-Eval: A Benchmark Dataset for Spoken Dialogue Understanding Beyond Words☆42Updated 4 months ago
- [AAAI 2024] CTX-txt2vec, the acoustic model in UniCATS☆63Updated 8 months ago
- Real-time Speech-Text Foundation Model Toolkit (wip)☆119Updated 3 weeks ago
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆38Updated last week
- Official release of StyleTalk dataset.☆57Updated 4 months ago
- Source for the Interspeech 2024 Paper "Scaling up masked audio encoder learning for general audio classification"☆44Updated 2 months ago
- ☆53Updated 10 months ago
- ☆62Updated 9 months ago
- This repository contains prompts & best practices to annotate audio clips with a very high degree of details using Audio-Language-Models☆29Updated 3 weeks ago
- Paper, Code and Resources for Speech Language Model and End2End Speech Dialogue System.☆61Updated this week
- A 6-million Audio-Caption Paired Dataset Built with a LLMs and ALMs-based Automatic Pipeline☆55Updated last week
- Unified Speech Language Model for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"(ICLR 2024)☆136Updated last year
- This is the official train-dev-test release of the Interspeech2024 Discrete Speech Representation Challenge.☆32Updated 9 months ago
- [EMNLP 2024] ESC: Efficient Speech Coding with Cross-Scale Residual Vector Quantized Transformers☆90Updated 3 weeks ago
- Codec Does Matter: Exploring the Semantic Shortcoming of Codec for Audio Language Model☆102Updated last month
- Unofficial pytorch reproduction for the paper "Utilizing Neural Transducers for Two-Stage Text-to-Speech via Semantic Token Prediction" (…☆58Updated 7 months ago
- ☆41Updated 3 weeks ago
- Models and code for RepCodec: A Speech Representation Codec for Speech Tokenization☆157Updated 4 months ago
- The open source code for SimpleSpeech series☆108Updated last month
- trying to reproduce suno v3☆25Updated 7 months ago
- Evaluation Protocol for Large-Scale Zero-Shot TTS Literature☆65Updated last month
- ☆57Updated 2 months ago
- Ultra-low-bitrate Speech Codec for Speech Language Modeling Applications☆61Updated last month
- [INTERSPEECH 2023 Best Paper Shortlist] Official implementation for MT4SSL: Boosting Self-Supervised Speech Representation Learning by In…☆43Updated 7 months ago
- ☆35Updated 9 months ago