kyutai-labs / nanoGPTaudioLinks
Code for the blog "Neural audio codecs: how to get audio into LLMs"
☆110Updated last week
Alternatives and similar repositories for nanoGPTaudio
Users that are interested in nanoGPTaudio are comparing it to the libraries listed below
Sorting:
- [EMNLP 2024] ESC: Efficient Speech Coding with Cross-Scale Residual Vector Quantized Transformers☆123Updated 7 months ago
- Streamable Text-to-Speech model using a language modeling approach, without vector quantization☆99Updated 5 months ago
- Ultra-low-bitrate Speech Codec for Speech Language Modeling Applications☆81Updated 10 months ago
- ☆100Updated last month
- A single-layer, streaming codec model providing SOTA audio quality and discrete tokens designed for superior downstream modelability.☆101Updated 4 months ago
- [ACL 2024] Generative Pre-Trained Speech Language Model with Efficient Hierarchical Transformer☆65Updated 11 months ago
- Official implementation of paper: Shallow Flow Matching for Coarse-to-Fine Text-to-Speech Synthesis☆44Updated last month
- ☆80Updated 3 months ago
- Implementation of Acoustic BPE (Shen et al., 2024), extended for RVQ-based Neural Audio Codecs☆73Updated 3 months ago
- MeanAudio: Fast and Faithful Text-to-Audio Generation with Mean Flows☆105Updated last month
- A trainer for SNAC (Multi-Scale Neural Audio Codec) has replaced the decoder with Vocos.☆58Updated last year
- ☆50Updated 7 months ago
- We Speech Toolkit, LLM based Speech Toolkit for Speech Understanding, Generation, and Interaction☆69Updated 2 weeks ago
- [ACL 2025] OZSpeech: One-step Zero-shot Speech Synthesis with Learned-Prior-Conditioned Flow Matching☆41Updated 8 months ago
- The open-source code of UniAudio2.0☆74Updated last month
- Trainging, inference, and testing of the SAC speech codec model.☆81Updated last week
- E2E TTS using Conditional Flow Matching (Experimental*)☆71Updated last year
- ☆70Updated last year
- A low-bitrate single-codebook 16 / 24 kHz speech codec based on focal modulation☆110Updated last month
- small audio language model for reasoning☆80Updated 6 months ago
- Variable Bitrate Residual Vector Quantization for Audio Coding☆49Updated 6 months ago
- PyTorch implementation of Miipher-2 [2025] which is a speech restoration model by Google DeepMind☆52Updated last month
- Inference code for Audiodec-Valle-Wenetspeech4TTS☆50Updated last year
- The open source code of ALMTokenizer2: Towards Low bit-rate and Semantic-rich Audio Tokenizer with Flow-based Scalar Diffusion Transforme…☆42Updated last month
- [ICASSP 2025] "FLowHigh: Towards efficient and high-quality audio super-resolution with single-step flow matching"☆80Updated 9 months ago
- The official repository for the paper “NonVerbalSpeech-38K: A Scalable Pipeline for Enabling Non-Verbal Speech Generation and Understandi…☆50Updated last month
- Streaming Vocos☆29Updated 4 months ago
- Contains the code associated with the ICLR submission for our text-to-speech diffusion model☆54Updated 2 years ago
- SoloAudio: Target Sound Extraction with Language-oriented Audio Diffusion Transformer.☆104Updated 10 months ago
- X-E-Speech: Joint Training Framework of Non-Autoregressive Cross-lingual Emotional Text-to-Speech and Voice Conversion☆107Updated last year