jishengpeng / WavTokenizer
SOTA discrete acoustic codec models with 40 tokens per second for audio language modeling
☆797Updated this week
Related projects ⓘ
Alternatives and complementary repositories for WavTokenizer
- PyTorch Implementation of AudioLCM (ACM-MM'24): a efficient and high-quality text-to-audio generation with latent consistency model.☆1,136Updated 3 weeks ago
- Official repo for WavCraft, an AI agent for audio creation and editing☆653Updated 2 months ago
- PyTorch Implementation of Make-An-Audio (ICML'23) with a Text-to-Audio Generative Model☆753Updated 6 months ago
- AcademiCodec: An Open Source Audio Codec Model for Academic Research☆596Updated 10 months ago
- Code for paper "GenTranslate: Large Language Models are Generative Multilingual Speech and Machine Translators"☆225Updated 4 months ago
- Dataset and code of GTSinger(NeurIPS 2024 Spotlight): A Global Multi-Technique Singing Corpus with Realistic Music Scores for All Singing…☆229Updated this week
- PyTorch Implementation of StyleSinger(AAAI 2024): Style Transfer for Out-of-Domain Singing Voice Synthesis☆340Updated 2 weeks ago
- Code for paper "Large Language Models are Efficient Learners of Noise-Robust Speech Recognition"☆157Updated 6 months ago
- A large chinese freelanguage chain tools,you can get free API from:open.bigmodel.cn☆108Updated 9 months ago
- The codes about "Uni-MoE: Scaling Unified Multimodal Models with Mixture of Experts"☆771Updated 2 months ago
- Language-Codec: Reducing the Gaps Between Discrete Codec Representation and Speech Language Models☆210Updated 2 months ago
- Towards Open-source GPT-4o with Vision, Speech and Duplex Capabilities。☆1,593Updated 2 weeks ago
- [IJCV] Show-1: Marrying Pixel and Latent Diffusion Models for Text-to-Video Generation☆1,103Updated last week
- Code for paper "Self-Taught Recognizer: Toward Unsupervised Adaptation for Speech Foundation Models"☆284Updated 6 months ago
- ControlSpeech: Towards Simultaneous Zero-shot Speaker Cloning and Zero-shot Language Style Control With Decoupled Codec☆196Updated this week
- PyTorch Implementation of GenerSpeech (NeurIPS'22): a text-to-speech model towards zero-shot style transfer of OOD custom voice.☆320Updated 9 months ago
- PyTorch Implementation of ProDiff (ACM-MM'22) with a Extremely-Fast diffusion speech synthesis pipeline☆432Updated last year
- Multi-Scale Neural Audio Codec (SNAC) compresses audio into discrete codes at a low bitrate☆439Updated this week
- This is the code for the SpeechTokenizer presented in the SpeechTokenizer: Unified Speech Tokenizer for Speech Language Models. Samples a…☆480Updated 5 months ago
- [NeurIPS 2024] An official implementation of ShareGPT4Video: Improving Video Understanding and Generation with Better Captions☆1,265Updated last month
- The Open Source Code of UniAudio☆522Updated 4 months ago
- ☆109Updated 8 months ago
- The "virtual_human_stream" project is a real-time digital human system supporting audio-video dialogue. It integrates models like ernerf,…☆611Updated 3 weeks ago
- Real-time and accurate open-vocabulary end-to-end object detection☆1,534Updated 2 months ago
- TextrolSpeech: A Text Style Control Speech Corpus With Codec Language Text-to-Speech Models (2024 ICASSP)☆142Updated 2 months ago
- PyTorch Implementation of FastDiff (IJCAI'22)☆407Updated 5 months ago
- PyTorch Implementation of TCSinger(EMNLP 2024): Zero-Shot Singing Voice Synthesis with Style Transfer and Multi-Level Style Control☆250Updated this week
- [ ICLR 2024 ] Official Codebase for "InstructCV: Instruction-Tuned Text-to-Image Diffusion Models as Vision Generalists"☆520Updated 6 months ago
- ☆203Updated last week
- In this repository, you will learn how code works in VITS(Conditional Variational Autoencoder with Adversarial Learning for End-to-End Te…☆161Updated last year