jishengpeng / WavTokenizer
[ICLR 2025] SOTA discrete acoustic codec models with 40/75 tokens per second for audio language modeling
☆1,033Updated this week
Alternatives and similar repositories for WavTokenizer:
Users that are interested in WavTokenizer are comparing it to the libraries listed below
- PyTorch Implementation of AudioLCM (ACM-MM'24): a efficient and high-quality text-to-audio generation with latent consistency model.☆898Updated 2 months ago
- PyTorch Implementation of Make-An-Audio (ICML'23) with a Text-to-Audio Generative Model☆632Updated 9 months ago
- Official repo for WavCraft, an AI agent for audio creation and editing☆522Updated 2 weeks ago
- AcademiCodec: An Open Source Audio Codec Model for Academic Research☆600Updated last year
- Dataset and code of GTSinger(NeurIPS 2024 Spotlight): A Global Multi-Technique Singing Corpus with Realistic Music Scores for All Singing…☆236Updated last week
- PyTorch Implementation of StyleSinger(AAAI 2024): Style Transfer for Out-of-Domain Singing Voice Synthesis☆324Updated last month
- Code for paper "GenTranslate: Large Language Models are Generative Multilingual Speech and Machine Translators"☆193Updated 7 months ago
- PyTorch Implementation of TCSinger(EMNLP 2024): Zero-Shot Singing Voice Synthesis with Style Transfer and Multi-Level Style Control☆276Updated last month
- Multi-Scale Neural Audio Codec (SNAC) compresses audio into discrete codes at a low bitrate☆490Updated 3 months ago
- Towards Open-source GPT-4o with Vision, Speech and Duplex Capabilities。☆1,649Updated last month
- Code for paper "Self-Taught Recognizer: Toward Unsupervised Adaptation for Speech Foundation Models"☆239Updated 9 months ago
- Code for paper "Large Language Models are Efficient Learners of Noise-Robust Speech Recognition"☆137Updated 9 months ago
- The codes about "Uni-MoE: Scaling Unified Multimodal Models with Mixture of Experts"☆694Updated last month
- [IJCV] Show-1: Marrying Pixel and Latent Diffusion Models for Text-to-Video Generation☆1,021Updated 3 months ago
- Language-Codec: Reducing the Gaps Between Discrete Codec Representation and Speech Language Models☆206Updated 3 months ago
- The official implementation of MARS: Unleashing the Power of Variance Reduction for Training Large Models☆545Updated 3 weeks ago
- PyTorch Implementation of ProDiff (ACM-MM'22) with a Extremely-Fast diffusion speech synthesis pipeline☆430Updated last year
- Lyra: An Efficient and Speech-Centric Framework for Omni-Cognition☆279Updated last month
- This is the code for the SpeechTokenizer presented in the SpeechTokenizer: Unified Speech Tokenizer for Speech Language Models. Samples a…☆529Updated 8 months ago
- A large chinese freelanguage chain tools,you can get free API from:open.bigmodel.cn☆80Updated last year
- Vchitect-2.0: Parallel Transformer for Scaling Up Video Diffusion Models☆888Updated last month
- ControlSpeech: Towards Simultaneous Zero-shot Speaker Cloning and Zero-shot Language Style Control With Decoupled Codec☆211Updated 3 months ago
- A toolkit enhances PyTorch with specialized functions for low-bit quantized neural networks.☆197Updated 8 months ago
- Video generation from text&image, 1st-gen☆791Updated 2 weeks ago
- PyTorch Implementation of GenerSpeech (NeurIPS'22): a text-to-speech model towards zero-shot style transfer of OOD custom voice.☆320Updated last year
- PyTorch implementation of Audio Flamingo: A Novel Audio Language Model with Few-Shot Learning and Dialogue Abilities.☆228Updated 5 months ago
- Hallo2: Long-Duration and High-Resolution Audio-driven Portrait Image Animation☆3,493Updated this week
- The Open Source Code of UniAudio☆545Updated 7 months ago