llm-jp / llama-mimiLinks
Llama-Mimi is a speech language model that uses a unified tokenizer (Mimi) and a single Transformer decoder (Llama) to jointly model sequences of interleaved semantic and acoustic tokens.
☆28Updated 3 months ago
Alternatives and similar repositories for llama-mimi
Users that are interested in llama-mimi are comparing it to the libraries listed below
Sorting:
- Code associated with the paper: CTC-DRO: Robust Optimization for Reducing Language Disparities in Speech Recognition.☆15Updated 7 months ago
- Text-to-Speech Latency Benchmark☆22Updated 5 months ago
- SpeechGLUE is a speech version of the GLUE benchmark, driven by text-to-speech.☆13Updated 2 years ago
- This app is intended to automatically create a corpus for ASR systems using pseudo-labeling.☆27Updated last year
- Zero-Shot Foreign Accent Conversion without a Native Reference☆35Updated last year
- GPT for FACodec☆13Updated last year
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax☆16Updated last year
- Open TTS models, built for streaming on the edge☆44Updated 9 months ago
- Audio tokenization, in the fastest way possible!☆53Updated last year
- ☆19Updated 9 months ago
- LoRA-based phoneme/prosody control for LLM-based TTS with no G2P - Lightweight adapter for edit and control the target language's phoneme…☆21Updated 4 months ago
- Fine-tuning Moshi/J-Moshi on your own spoken dialogue data☆79Updated 4 months ago
- The YouTube Text-To-Speech dataset is comprised of waveform audio extracted from YouTube videos alongside their English transcriptions☆52Updated 4 years ago
- My vocoder experiments☆31Updated 4 months ago
- The official code for the SALMon🍣 benchmark (ICASSP 2025 - Oral)☆47Updated 4 months ago
- Collection of scripts from mHuBERT-147.☆32Updated last year
- This is a fork of the original fairseq repository (version 0.12.2) with added classes for training mHuBERT-147.☆19Updated last year
- a Neural Vocoder supporting Ring Attention, Conformer and NSF.☆23Updated 4 months ago
- ☆15Updated last month
- Forced alignment decoder for Whisper.☆14Updated last year
- A TTS Trained on Universal Audio.☆41Updated 6 months ago
- Unofficial implementation of ConvNeXt-TTS powered by lightning☆17Updated last year
- ☆14Updated last year
- A collection of all our phonemeizers for dataset construction and inference☆27Updated 10 months ago
- ☆58Updated last year
- Conformer block with Rotary Position Embedding, modified from lucidrains' implement☆16Updated last year
- This is not remotely close to a finished product, and does not intend to nor does this claim to be working fine-tuning code for MaskGCT. …☆12Updated last year
- PyTorch implementation of Miipher-2 [2025] which is a speech restoration model by Google DeepMind☆61Updated 2 months ago
- My hybrid TTS network that combines, VALL-E, VoiceBox, SpeechFlow, Seamless and TortoiseTTS into one☆26Updated last year
- A multilingual phoneme recognizer capable of generalizing zero-shot to unseen phoneme inventories.☆27Updated 9 months ago