elyxlz / voxtralLinks
Voxtral: Convert Mistral into a end2end SpeechLM. No information bottleneck, preserves prosody, learns interruptions from data. Unlike GPT4o (closed) or Moshi (complex), it's open, simple, natural.
☆37Updated 9 months ago
Alternatives and similar repositories for voxtral
Users that are interested in voxtral are comparing it to the libraries listed below
Sorting:
- 🎙️ Automatically transcribe audio/video into high-quality, speaker-specific Text-To-Speech datasets ✨☆130Updated 4 months ago
- A package for NeuCodec: a 50hz, 0.8kbps, 24kHz audio codec.☆133Updated 2 months ago
- DACVAE☆124Updated this week
- Open TTS models, built for streaming on the edge☆44Updated 9 months ago
- ☆60Updated this week
- Trying to build an all in one speech-text language model - a bit like GPT-4o☆22Updated last year
- Provide Gradio custom components to make the diarization-based audio labeling process easier and faster.☆69Updated 2 months ago
- Collection of Open Source Speech Data☆163Updated 2 months ago
- Audio tokenization, in the fastest way possible!☆53Updated last year
- ☆62Updated last year
- ☆218Updated 2 months ago
- [NCMMSC'2024] Emotion-Aware Prosodic Phrasing for Expressive Text-to-Speech☆22Updated last year
- This repository contains the code and data for the paper EmoKnob: Enhance Voice Cloning with Fine-Grained Emotion Control by Haozhe Chen,…☆80Updated last year
- LongCat Audio Tokenizer and Detokenizer☆261Updated 2 weeks ago
- SlamKit is an open source tool kit for efficient training of SpeechLMs. It was used for "Slamming: Training a Speech Language Model on On…☆224Updated 7 months ago
- An unofficial PyTorch implementation of VALL-E☆88Updated 4 months ago
- This repository contains a series of works on diffusion-based speech tokenizers, including the official implementation of the paper: "TaD…☆195Updated 3 months ago
- A collection of optimized utilities for text-to-audio processing, enhancing both training and inference workflows. This repository contai…☆41Updated 8 months ago
- A lightweight, efficient variation of the StyleTTS 2 text‐to‐speech model.☆49Updated 6 months ago
- This is a repository that collects common audio noise reduction models, using Gradio to demonstrate the use of each model, which is very …☆48Updated last year
- Whisper Speaker Identification (WSI), a cutting-edge model for multilingual speaker identification.☆25Updated 9 months ago
- EchoX: Towards Mitigating Acoustic-Semantic Gap via Echo Training for Speech-to-Speech LLMs☆42Updated 3 months ago
- ☆90Updated 2 months ago
- A TTS model capable of generating ultra-realistic dialogue in one pass.☆219Updated 7 months ago
- ☆41Updated 5 months ago
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax☆16Updated last year
- This project is to train an RWKV LLM for TTS generation which compatible to other TTS engine(like fish/cosy/chattts).☆91Updated 2 months ago
- Official implementation of the TTS model Lina-Speech☆175Updated 11 months ago
- Accompanying repository for the paper "DiffVox: A Differentiable Model for Capturing and Analysing Professional Effects Distributions"☆36Updated last month
- An open source community implementation of the model MELLE from the paper: "Autoregressive Speech Synthesis without Vector Quantization"☆13Updated this week