elyxlz / voxtralLinks
Voxtral: Convert Mistral into a end2end SpeechLM. No information bottleneck, preserves prosody, learns interruptions from data. Unlike GPT4o (closed) or Moshi (complex), it's open, simple, natural.
☆36Updated 8 months ago
Alternatives and similar repositories for voxtral
Users that are interested in voxtral are comparing it to the libraries listed below
Sorting:
- Open TTS models, built for streaming on the edge☆44Updated 8 months ago
- A package for NeuCodec: a 50hz, 0.8kbps, 24kHz audio codec.☆120Updated last month
- 🎙️ Automatically transcribe audio/video into high-quality, speaker-specific Text-To-Speech datasets ✨☆128Updated 3 months ago
- ☆60Updated last week
- Trying to build an all in one speech-text language model - a bit like GPT-4o☆22Updated last year
- This is a repository that collects common audio noise reduction models, using Gradio to demonstrate the use of each model, which is very …☆48Updated 11 months ago
- Audio tokenization, in the fastest way possible!☆53Updated last year
- LongCat Audio Tokenizer and Detokenizer☆252Updated last week
- Provide Gradio custom components to make the diarization-based audio labeling process easier and faster.☆68Updated last month
- ☆62Updated last year
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax☆15Updated last year
- EchoX: Towards Mitigating Acoustic-Semantic Gap via Echo Training for Speech-to-Speech LLMs☆41Updated 2 months ago
- ☆40Updated 4 months ago
- [NCMMSC'2024] Emotion-Aware Prosodic Phrasing for Expressive Text-to-Speech☆22Updated last year
- A lightweight, efficient variation of the StyleTTS 2 text‐to‐speech model.☆49Updated 6 months ago
- StyleTTS 2 Optimized Training Fork☆34Updated 9 months ago
- The demo page of UniAudio☆34Updated last year
- Accompanying repository for the paper "DiffVox: A Differentiable Model for Capturing and Analysing Professional Effects Distributions"☆35Updated last month
- ☆203Updated last month
- SlamKit is an open source tool kit for efficient training of SpeechLMs. It was used for "Slamming: Training a Speech Language Model on On…☆221Updated 6 months ago
- Collection of Open Source Speech Data☆163Updated last month
- This repository contains a series of works on diffusion-based speech tokenizers, including the official implementation of the paper: "TaD…☆193Updated 2 months ago
- Official code of the paper: Draw an Audio: Leveraging Multi-Instruction for Video-to-Audio Synthesis.☆45Updated last year
- An unofficial PyTorch implementation of VALL-E☆88Updated 3 months ago
- VoiceBox neural network implementation☆110Updated last year
- GPT-style network for phonemization with durations of text☆67Updated last year
- Codebase and project page for EDMSound☆35Updated 2 years ago
- ☆22Updated 3 months ago
- ☆44Updated 4 months ago
- Whisper Speaker Identification (WSI), a cutting-edge model for multilingual speaker identification.☆25Updated 8 months ago