elyxlz / voxtralLinks
Voxtral: Convert Mistral into a end2end SpeechLM. No information bottleneck, preserves prosody, learns interruptions from data. Unlike GPT4o (closed) or Moshi (complex), it's open, simple, natural.
☆35Updated 7 months ago
Alternatives and similar repositories for voxtral
Users that are interested in voxtral are comparing it to the libraries listed below
Sorting:
- Open TTS models, built for streaming on the edge☆43Updated 7 months ago
- Trying to build an all in one speech-text language model - a bit like GPT-4o☆22Updated last year
- ☆62Updated last year
- ☆60Updated last month
- A package for NeuCodec: a 50hz, 0.8kbps, 24kHz audio codec.☆99Updated last week
- Audio tokenization, in the fastest way possible!☆53Updated last year
- Implementation of E2-TTS, "Embarrassingly Easy Fully Non-Autoregressive Zero-Shot TTS", in MLX☆20Updated last year
- 🎙️ Automatically transcribe audio/video into high-quality, speaker-specific Text-To-Speech datasets ✨☆127Updated 2 months ago
- Ming-UniAudio: Speech LLM for Joint Understanding, Generation and Editing with Unified Representation☆213Updated last week
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax☆15Updated last year
- ☆184Updated this week
- ☆21Updated last month
- [NCMMSC'2024] Emotion-Aware Prosodic Phrasing for Expressive Text-to-Speech☆22Updated last year
- Official code of the paper: Draw an Audio: Leveraging Multi-Instruction for Video-to-Audio Synthesis.☆46Updated last year
- This is a repository that collects common audio noise reduction models, using Gradio to demonstrate the use of each model, which is very …☆46Updated 10 months ago
- Collection of Open Source Speech Data☆161Updated 2 weeks ago
- BUD-E (Buddy) is an open-source voice assistant framework that facilitates seamless interaction with AI models and APIs, enabling the cre…☆22Updated last year
- EchoX: Towards Mitigating Acoustic-Semantic Gap via Echo Training for Speech-to-Speech LLMs☆38Updated 3 weeks ago
- An open source community implementation of the model MELLE from the paper: "Autoregressive Speech Synthesis without Vector Quantization"☆11Updated last week
- The official code repository for SongPrep: A Preprocessing Framework and End-to-end Model for Full-song Structure Parsing and Lyrics Tran…☆86Updated last week
- Provide Gradio custom components to make the diarization-based audio labeling process easier and faster.☆68Updated last month
- An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO☆29Updated this week
- ☆19Updated last year
- ☆23Updated 11 months ago
- Liquid Audio - Speech-to-Speech audio models by Liquid AI☆193Updated 2 weeks ago
- ☆39Updated last year
- SlamKit is an open source tool kit for efficient training of SpeechLMs. It was used for "Slamming: Training a Speech Language Model on On…☆218Updated 5 months ago
- Whisper Speaker Identification (WSI), a cutting-edge model for multilingual speaker identification.☆24Updated 7 months ago
- ☆39Updated 3 months ago
- ☆265Updated last month