llm-jp / llama-mimiLinks
Llama-Mimi is a speech language model that uses a unified tokenizer (Mimi) and a single Transformer decoder (Llama) to jointly model sequences of interleaved semantic and acoustic tokens.
☆26Updated 2 months ago
Alternatives and similar repositories for llama-mimi
Users that are interested in llama-mimi are comparing it to the libraries listed below
Sorting:
- Code associated with the paper: CTC-DRO: Robust Optimization for Reducing Language Disparities in Speech Recognition.☆15Updated 6 months ago
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax☆15Updated last year
- LoRA-based phoneme/prosody control for LLM-based TTS with no G2P - Lightweight adapter for edit and control the target language's phoneme…☆17Updated 3 months ago
- a Neural Vocoder supporting Ring Attention, Conformer and NSF.☆22Updated 3 months ago
- A TTS Trained on Universal Audio.☆41Updated 5 months ago
- Text-to-Speech Latency Benchmark☆20Updated 4 months ago
- ☆15Updated last week
- PyTorch implementation of Miipher-2 [2025] which is a speech restoration model by Google DeepMind☆58Updated 2 months ago
- Fine-tuning Moshi/J-Moshi on your own spoken dialogue data☆76Updated 3 months ago
- Unofficial implementation of ConvNeXt-TTS powered by lightning☆17Updated last year
- SpeechGLUE is a speech version of the GLUE benchmark, driven by text-to-speech.☆13Updated 2 years ago
- VITS2 using Phoneme-Level Japanese BERT☆14Updated last year
- Conformer block with Rotary Position Embedding, modified from lucidrains' implement☆16Updated last year
- My vocoder experiments☆31Updated 3 months ago
- A collection of all our phonemeizers for dataset construction and inference☆27Updated 9 months ago
- Forced alignment decoder for Whisper.☆14Updated last year
- StyleTTS 2 Optimized Training Fork☆34Updated 9 months ago
- My hybrid TTS network that combines, VALL-E, VoiceBox, SpeechFlow, Seamless and TortoiseTTS into one☆26Updated last year
- T5Voice is a lightweight PyTorch implementation of T5-based text-to-speech synthesis, supporting both streaming and non-streaming speech …☆26Updated 2 weeks ago
- Open TTS models, built for streaming on the edge☆44Updated 8 months ago
- ☆14Updated last year
- ☆44Updated 4 months ago
- ☆48Updated last year
- Implementation of vocoders empowered with pytorch lightning☆18Updated last year
- Pushing the Limits of Zero-shot End-to-End Speech Translation☆26Updated 11 months ago
- The official code for the SALMon🍣 benchmark (ICASSP 2025 - Oral)☆47Updated 3 months ago
- Acoustic Neighbor Embeddings☆28Updated 4 months ago
- This is a fork of the original fairseq repository (version 0.12.2) with added classes for training mHuBERT-147.☆19Updated last year
- Descript Audio Codec - VAE Variant (.dac-vae): High-Fidelity Audio Compression with Variational Autoencoder☆28Updated 2 months ago
- Collection of scripts from mHuBERT-147.☆32Updated last year