kyutai-labs / nanoGPTaudioLinks
Code for the blog "Neural audio codecs: how to get audio into LLMs"
☆149Updated 3 months ago
Alternatives and similar repositories for nanoGPTaudio
Users that are interested in nanoGPTaudio are comparing it to the libraries listed below
Sorting:
- A trainer for SNAC (Multi-Scale Neural Audio Codec) has replaced the decoder with Vocos.☆64Updated last year
- An neural full-band audio codec for general audio sampled at 48 kHz with 7.5 kps or 4.5 kbps.☆197Updated 6 months ago
- ☆105Updated 3 months ago
- Streamable Text-to-Speech model using a language modeling approach, without vector quantization☆107Updated 8 months ago
- SoloAudio: Target Sound Extraction with Language-oriented Audio Diffusion Transformer.☆113Updated last year
- [EMNLP 2024] ESC: Efficient Speech Coding with Cross-Scale Residual Vector Quantized Transformers☆124Updated 10 months ago
- small audio language model for reasoning☆86Updated last month
- ☆96Updated 3 months ago
- A single-layer, streaming codec model providing SOTA audio quality and discrete tokens designed for superior downstream modelability.☆112Updated 7 months ago
- Implementation of Acoustic BPE (Shen et al., 2024), extended for RVQ-based Neural Audio Codecs☆77Updated last month
- This repository contains a series of works on diffusion-based speech tokenizers, including the official implementation of the paper: "TaD…☆197Updated 4 months ago
- ☆43Updated 11 months ago
- ☆99Updated last week
- Official implementation of paper: Shallow Flow Matching for Coarse-to-Fine Text-to-Speech Synthesis☆50Updated 4 months ago
- MeanAudio: Fast and Faithful Text-to-Audio Generation with Mean Flows☆122Updated 4 months ago
- Official implementation for FlowSep☆69Updated last year
- [ACL 2024] Generative Pre-Trained Speech Language Model with Efficient Hierarchical Transformer☆67Updated last year
- The official repository for the paper “NonVerbalSpeech-38K: A Scalable Pipeline for Enabling Non-Verbal Speech Generation and Understandi…☆62Updated last month
- Audio-FLAN☆160Updated 4 months ago
- Elucidated Text-To-Audio (ETTA) is a SOTA text-to-audio model with a holistic understanding of the design space and trained with syntheti…☆98Updated 3 months ago
- Ultra-low-bitrate Speech Codec for Speech Language Modeling Applications☆84Updated last year
- The open source code for SimpleSpeech series☆145Updated last year
- Official code for "F5R-TTS: Improving Flow-Matching based Text-to-Speech with Group Relative Policy Optimization"☆145Updated 7 months ago
- ☆124Updated 11 months ago
- Codebase for the paper 'EncodecMAE: Leveraging neural codecs for universal audio representation learning'☆101Updated last year
- Official code for "EmoVoice: LLM-based Emotional Text-To-Speech Model with Freestyle Text Prompting"☆107Updated 3 months ago
- Official code for "Semantic-VAE: Semantic-Alignment Latent Representation for Better Speech Synthesis"☆106Updated last month
- [NeurIPS' 25] Benchmark for evaluating TTS models on complex prosodic, expressiveness, and linguistic challenges.☆188Updated last month
- [ACL 2025] OZSpeech: One-step Zero-shot Speech Synthesis with Learned-Prior-Conditioned Flow Matching☆44Updated 11 months ago
- The open-source code of UniAudio2.0☆74Updated 4 months ago