Voxtral: Convert Mistral into a end2end SpeechLM. No information bottleneck, preserves prosody, learns interruptions from data. Unlike GPT4o (closed) or Moshi (complex), it's open, simple, natural.
☆42Mar 7, 2025Updated last year
Alternatives and similar repositories for voxtral
Users that are interested in voxtral are comparing it to the libraries listed below
Sorting:
- (WIP)long form speech generatoins☆31Apr 2, 2025Updated 11 months ago
- WavBench: Benchmarking Reasoning, Colloquialism, and Paralinguistics for End-to-End Spoken Dialogue Models☆27Feb 13, 2026Updated 3 weeks ago
- MuChin: A Chinese Colloquial Description Benchmark for Evaluating Language Models in the Field of Music☆26Jan 7, 2026Updated 2 months ago
- Optimized for 8Gb inference LTX-2 audio–video generative model. + Web UI. Model created by:☆27Updated this week
- Baseline system for Language-based Audio Retrieval (Task 6B) in DCASE 2023 Challenge☆10Aug 8, 2023Updated 2 years ago
- Official implementation of the paper titled "Age and Gender Recognition Using a Convolutional Neural Network with a Specially Designed Mu…☆27Mar 5, 2024Updated 2 years ago
- NanoGPT (124M) in 5 minutes☆15Feb 14, 2025Updated last year
- MT3:多任务多音轨音乐转录的 Gradio 演示。(全中文汉化)☆12Mar 24, 2025Updated 11 months ago
- SoloAudio: Target Sound Extraction with Language-oriented Audio Diffusion Transformer.☆114Jan 28, 2026Updated last month
- Repository of the WACV'24 paper "Can CLIP Help Sound Source Localization?"☆34Feb 21, 2025Updated last year
- Forced alignment decoder for Whisper.☆14Mar 13, 2024Updated last year
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax☆16Jun 16, 2024Updated last year
- FlashCosyVoice: A lightweight vLLM implementation built from scratch for CosyVoice.☆242Feb 25, 2026Updated last week
- Text-To-Speech for NotebookLM☆39Jul 20, 2025Updated 7 months ago
- Simple voice activity detection (VAD) algorithm in Python☆15Aug 10, 2023Updated 2 years ago
- audiolm-pytorch training code☆15Jul 31, 2023Updated 2 years ago
- A streaming audio reader, processor, and writer built on top of soundfile, and PyAV (bindings for FFmpeg)☆38Updated this week
- ☆19Sep 9, 2024Updated last year
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆78Nov 1, 2024Updated last year
- Make-An-Audio-3: Transforming Text/Video into Audio via Flow-based Large Diffusion Transformers☆119May 19, 2025Updated 9 months ago
- Try to replicate the architecture of MiniMaxTTS mentioned in it's technical report☆49Sep 2, 2025Updated 6 months ago
- noise reduction☆17Jul 3, 2024Updated last year
- [ACL 2025] OZSpeech: One-step Zero-shot Speech Synthesis with Learned-Prior-Conditioned Flow Matching☆45Feb 9, 2025Updated last year
- A unified tokenizer that is capable of both extracting semantic information and enabling high-fidelity audio reconstruction.☆134Sep 19, 2025Updated 5 months ago
- PyTorch implementation of the ICASSP-24 paper: "Improving Audio Captioning Models with Fine-grained Audio Features, Text Embedding Superv…☆39Jan 6, 2024Updated 2 years ago
- Python skeleton and library for OneCode projects, from Prototyping to Production☆30Feb 19, 2026Updated 2 weeks ago
- Official Repository for Task-Circuit Quantization☆24Jun 1, 2025Updated 9 months ago
- VoxInstruct: Expressive Human Instruction-to-Speech Generation with Unified Multilingual Codec Language Modelling☆97Nov 9, 2024Updated last year
- Example code using the DSPy framework.☆20May 30, 2024Updated last year
- ☆23Oct 17, 2024Updated last year
- ☆28Oct 7, 2025Updated 5 months ago
- Trying to build an all in one speech-text language model - a bit like GPT-4o☆22Jun 1, 2024Updated last year
- a Frontier Japanese Speech Generation net☆61May 15, 2025Updated 9 months ago
- Implementation of Diffusion Transformers and Rectified Flow in Jax☆27Jul 9, 2024Updated last year
- Baseline for DCASE 2024 Task 9: "Language-Queried Audio Source Separation"☆26Mar 27, 2024Updated last year
- Implementation of tinyCLAP.☆26Sep 28, 2024Updated last year
- ☆45Aug 28, 2025Updated 6 months ago
- [ICLR 2026] Data Pipeline, Models, and Benchmark for Omni-Captioner.☆119Oct 17, 2025Updated 4 months ago
- AudioStretchy is a Python wrapper around the `audio-stretch` C library, which performs fast, high-quality time-stretching of WAV/MP3 file…☆61Sep 24, 2025Updated 5 months ago