Llama-Mimi is a speech language model that uses a unified tokenizer (Mimi) and a single Transformer decoder (Llama) to jointly model sequences of interleaved semantic and acoustic tokens.
☆31Sep 20, 2025Updated last year
Alternatives and similar repositories for llama-mimi
Users that are interested in llama-mimi are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- JAX implementation of Large Language Models. You can train GPT-2-like model with 青空文庫 (aozora bunko-clean dataset) or any other text dat…☆13Aug 5, 2024Updated 2 years ago
- Repo for Paper: Towards Robust Speaker Recognition against Intrinsic Variation with Foundation Model Few-shot Tuning and Effective Speech…☆11Sep 24, 2025Updated last year
- ☆36Oct 2, 2026Updated last month
- ☆13May 11, 2026Updated 5 months ago
- Official implementation of "Wave-Trainer-Fit: Neural Vocoder with Trainable Prior and Fixed-Point Iteration towards High-Quality Speech G…☆16Feb 6, 2026Updated 9 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- PASQA: Pitch-Accent-Focused Speech Quality Assessment Model Trained on Synthetic Speech with Accent Errors☆26Updated this week
- jax port of snac☆11May 12, 2024Updated 2 years ago
- A variable-frame-rate 16 kHz speech codec based on FocalCodec☆21Feb 11, 2026Updated 8 months ago
- Multi-talker ASR based on DiCoW with Serialized Output Training☆20Sep 18, 2025Updated last year
- ☆29Aug 1, 2026Updated 3 months ago
- PyTorch implementation of Miipher-2 [2025] which is a speech restoration model by Google DeepMind☆72Oct 24, 2026Updated last week
- ☆12Mar 11, 2025Updated last year
- JATTS: A modern, research-oriented Japanese Text-to-speech Open-sourced Toolkit☆44Mar 13, 2026Updated 7 months ago
- An attempt to reproduce CALM (Continuous Audio Language Models) using DACVAE as the audio VAE.☆20Feb 20, 2026Updated 8 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Accepted by ACL26 Main, Oral☆46May 19, 2026Updated 5 months ago
- ☆11Dec 15, 2025Updated 10 months ago
- [ACL 2026] Dual-Axis Generative Reward Model Toward Semantic and Turn-taking Robustness in Interactive Spoken Dialogue Models☆22May 23, 2026Updated 5 months ago
- ☆19Oct 27, 2026Updated last week
- FT-LLM2026で開発した日本語SpeechLLMの学習コード☆13Apr 5, 2026Updated 7 months ago
- A comprehensive framework to test audio comprehension of Large Audio Language Models.☆74Oct 10, 2026Updated 3 weeks ago
- [ACL 2025] Predicting Turn-Taking and Backchannel in Human-Machine Conversations Using Linguistic, Acoustic, and Visual Signals☆37Aug 11, 2025Updated last year
- ☆14Jun 3, 2026Updated 5 months ago
- Github repository for paper: Think Before You Talk: Enhancing Meaningful Dialogue Generation in Full-Duplex Speech Language Models with P…☆14Jun 15, 2026Updated 4 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- [ACL 2026] VoxMind: An End-to-End Agentic Spoken Dialogue System☆46Jul 8, 2026Updated 3 months ago
- VoXtream is a Full-Stream Zero-shot TTS model with Extremely Low Latency and Speaking rate Control☆257Oct 15, 2026Updated 3 weeks ago
- [ICLR 2026] StableToken: A state-of-the-art noise-robust semantic speech tokenizer featuring Voting-LFQ for resilient SpeechLLMs.☆35Feb 27, 2026Updated 8 months ago
- [ICME 2026] Semantic-Aware Interruption Detection in Spoken Dialogue Systems: Benchmark, Metric, and Model☆25Jun 3, 2026Updated 5 months ago
- Speech Resynthesis and Language Modeling☆27Jun 11, 2025Updated last year
- Official Pytorch implementation of "Omni-AVSR: Towards Unified Multimodal Speech Recognition with Large Language Models" [IEEE ICASSP 202…☆38Aug 20, 2026Updated 2 months ago
- fd-sds☆22Apr 8, 2026Updated 6 months ago
- [ICLR2026] FlexiCodec: A Dynamic Neural Audio Codec for Low Frame Rates☆55Aug 20, 2026Updated 2 months ago
- ☆48Jul 7, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Onset-and-Offset-Aware Sound Event Detection☆22Feb 10, 2025Updated last year
- ☆15Oct 22, 2026Updated 2 weeks ago
- Kanade is a single-layer disentangled speech tokenizer that extracts compact tokens suitable for both generative and discriminative model…☆120Jul 18, 2026Updated 3 months ago
- Evaluating Bias in Spoken Dialogue LLMs for Real-World Decisions and Recommendations☆10Jan 28, 2026Updated 9 months ago
- A lightweight, self-hostable tool for conducting subjective listening tests in a browser.☆31Sep 15, 2026Updated last month
- ☆10Jul 5, 2023Updated 3 years ago
- The official repository TimeAudio, a comprehensive framework that incorporates fine-grained acoustic cues into LALMs with enhanced module…☆31Nov 18, 2025Updated 11 months ago