jishengpeng / WavTokenizer
[ICLR 2025] SOTA discrete acoustic codec models with 40/75 tokens per second for audio language modeling
☆1,112Updated last month
Alternatives and similar repositories for WavTokenizer:
Users that are interested in WavTokenizer are comparing it to the libraries listed below
- PyTorch Implementation of AudioLCM (ACM-MM'24): a efficient and high-quality text-to-audio generation with latent consistency model.☆1,036Updated 3 weeks ago
- PyTorch Implementation of Make-An-Audio (ICML'23) with a Text-to-Audio Generative Model☆645Updated 11 months ago
- Official repo for WavCraft, an AI agent for audio creation and editing☆523Updated 2 months ago
- The first Large Audio Language Model that enables native in-depth thinking, which is trained on large-scale audio Chain-of-Thought data.☆212Updated last month
- Dataset and code of GTSinger(NeurIPS 2024 Spotlight): A Global Multi-Technique Singing Corpus with Realistic Music Scores for All Singing…☆280Updated last month
- PyTorch Implementation of StyleSinger(AAAI 2024): Style Transfer for Out-of-Domain Singing Voice Synthesis☆374Updated 2 weeks ago
- AcademiCodec: An Open Source Audio Codec Model for Academic Research☆610Updated last year
- PyTorch Implementation of TCSinger(EMNLP 2024): Zero-Shot Singing Voice Synthesis with Style Transfer and Multi-Level Style Control☆326Updated last week
- Multi-Scale Neural Audio Codec (SNAC) compresses audio into discrete codes at a low bitrate☆560Updated 5 months ago
- Towards Open-source GPT-4o with Vision, Speech and Duplex Capabilities。☆1,720Updated 3 months ago
- Code for paper "GenTranslate: Large Language Models are Generative Multilingual Speech and Machine Translators"☆195Updated 9 months ago
- The official Soundwave repository☆198Updated last month
- Code for paper "Self-Taught Recognizer: Toward Unsupervised Adaptation for Speech Foundation Models"☆240Updated 11 months ago
- Ola: Pushing the Frontiers of Omni-Modal Language Model☆334Updated last month
- [IJCV] Show-1: Marrying Pixel and Latent Diffusion Models for Text-to-Video Generation☆1,113Updated 5 months ago
- Official Implementation for "Lyra: An Efficient and Speech-Centric Framework for Omni-Cognition"☆284Updated 3 months ago
- The codes about "Uni-MoE: Scaling Unified Multimodal Models with Mixture of Experts"☆716Updated 2 weeks ago
- Code for paper "Large Language Models are Efficient Learners of Noise-Robust Speech Recognition"☆139Updated 11 months ago
- PyTorch implementation of Audio Flamingo 2: An Audio-Language Model with Long-Audio Understanding and Expert Reasoning Abilities.☆459Updated last week
- ☆128Updated last month
- This is the code for the SpeechTokenizer presented in the SpeechTokenizer: Unified Speech Tokenizer for Speech Language Models. Samples a…☆550Updated 10 months ago
- Vchitect-2.0: Parallel Transformer for Scaling Up Video Diffusion Models☆910Updated last month
- Language-Codec: Reducing the Gaps Between Discrete Codec Representation and Speech Language Models☆207Updated 5 months ago
- ControlSpeech: Towards Simultaneous Zero-shot Speaker Cloning and Zero-shot Language Style Control With Decoupled Codec☆232Updated 5 months ago
- OpenMusic: SOTA Text-to-music (TTM) Generation☆554Updated 2 months ago
- The official implementation of MARS: Unleashing the Power of Variance Reduction for Training Large Models☆610Updated this week
- The Open Source Code of UniAudio☆556Updated 9 months ago
- Unified automatic quality assessment for speech, music, and sound.☆465Updated 2 weeks ago
- Vocos: Closing the gap between time-domain and Fourier-based neural vocoders for high-quality audio synthesis☆918Updated 8 months ago
- Implementation of Voicebox, new SOTA Text-to-speech network from MetaAI, in Pytorch☆648Updated 6 months ago