youngsheen / SimVQ
SimVQ: Addressing Representation Collapse in Vector Quantized Models with One Linear Layer
☆124Updated this week
Related projects ⓘ
Alternatives and complementary repositories for SimVQ
- The official repository of SpeechCraft dataset, a large-scale expressive bilingual speech dataset with natural language descriptions.☆51Updated last month
- Official codebase for "Schrodinger Bridges Beat Diffusion Models on Text-to-Speech Synthesis" (https://arxiv.org/abs/2312.03491).☆122Updated 4 months ago
- ✨✨Freeze-Omni: A Smart and Low Latency Speech-to-speech Dialogue Model with Frozen LLM☆98Updated 2 weeks ago
- [Official Implementation] Acoustic Autoregressive Modeling 🔥☆57Updated 2 months ago
- Official repo for CoVoMix: Advancing Zero-Shot Speech Generation for Human-like Multi-talker Conversations☆32Updated last month
- Unified Speech Language Model for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"(ICLR 2024)☆139Updated last year
- Official Repository of IJCAI 2024 Paper: "BATON: Aligning Text-to-Audio Model with Human Preference Feedback"☆18Updated 3 months ago
- [ACL 2024] Generative Pre-Trained Speech Language Model with Efficient Hierarchical Transformer☆37Updated 2 weeks ago
- The open source code for LLM-Codec☆114Updated 3 months ago
- Real-time Speech-Text Foundation Model Toolkit (wip)☆122Updated last month
- Make-An-Audio-3: Transforming Text/Video into Audio via Flow-based Large Diffusion Transformers☆83Updated 3 weeks ago
- [AAAI 2024] CTX-txt2vec, the acoustic model in UniCATS☆63Updated this week
- Models and code for RepCodec: A Speech Representation Codec for Speech Tokenization☆160Updated 4 months ago
- Official release of StyleTalk dataset.☆57Updated 4 months ago
- Codec Does Matter: Exploring the Semantic Shortcoming of Codec for Audio Language Model☆104Updated last month
- Source for the Interspeech 2024 Paper "Scaling up masked audio encoder learning for general audio classification"☆44Updated 2 months ago
- Code for Talk With Human-like Agents: Empathetic Dialogue Through Perceptible Acoustic Reception and Reaction (ACL24))☆33Updated 3 months ago
- VoxInstruct: Expressive Human Instruction-to-Speech Generation with Unified Multilingual Codec Language Modelling☆41Updated last week
- Code for NeurIPS 2023 paper "DASpeech: Directed Acyclic Transformer for Fast and High-quality Speech-to-Speech Translation".☆60Updated 3 months ago
- Paper, Code and Resources for Speech Language Model and End2End Speech Dialogue System.☆106Updated last week
- ☆55Updated 11 months ago
- [NeurIPS 2024] SD-Eval: A Benchmark Dataset for Spoken Dialogue Understanding Beyond Words☆42Updated 4 months ago
- Keras implement of Finite Scalar Quantization☆63Updated last year
- A Survey of Spoken Dialogue Models (60 pages)☆86Updated last week
- [INTERSPEECH 2023 Best Paper Shortlist] Official implementation for MT4SSL: Boosting Self-Supervised Speech Representation Learning by In…☆43Updated 7 months ago
- [IJCAI 2024] EAT: Self-Supervised Pre-Training with Efficient Audio Transformer☆114Updated 7 months ago
- [AAAI 2024] Code for CTX-vec2wav in UniCATS☆122Updated 5 months ago
- trying to reproduce suno v3☆25Updated 7 months ago
- Evaluation Protocol for Large-Scale Zero-Shot TTS Literature☆66Updated last month
- All generative model in one for better TTS model☆66Updated 2 months ago