first base model for full-duplex conversational audio
☆1,785Jan 5, 2025Updated last year
Alternatives and similar repositories for hertz-dev
Users that are interested in hertz-dev are comparing it to the libraries listed below
Sorting:
- Interface for OuteTTS models.☆1,430Jun 21, 2025Updated 9 months ago
- Moshi is a speech-text foundation model and full-duplex spoken dialogue framework. It uses Mimi, a state-of-the-art streaming neural audi…☆9,832Mar 4, 2026Updated 2 weeks ago
- Inference code for the paper "Spirit-LM Interleaved Spoken and Written Language Model".☆929Oct 28, 2024Updated last year
- Local realtime voice AI☆2,439Nov 26, 2025Updated 3 months ago
- A fast multimodal LLM for real-time voice☆4,381Dec 12, 2025Updated 3 months ago
- LLaMA-Omni is a low-latency and high-quality end-to-end speech interaction model built upon Llama-3.1-8B-Instruct, aiming to achieve spee…☆3,135May 19, 2025Updated 10 months ago
- ✨✨Freeze-Omni: A Smart and Low Latency Speech-to-speech Dialogue Model with Frozen LLM☆372May 27, 2025Updated 9 months ago
- open-source multimodal large language model that can hear, talk while thinking. Featuring real-time end-to-end speech input and streaming…☆3,534Nov 5, 2024Updated last year
- Real-time Speech-Text Foundation Model Toolkit (wip)☆254Mar 26, 2025Updated 11 months ago
- GLM-4-Voice | 端到端中英语音对话模型☆3,152Dec 5, 2024Updated last year
- Inference and training library for high-quality TTS models.☆5,549Dec 10, 2024Updated last year
- Official code for "F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matching"☆14,223Updated this week
- Codec for paper: LLaSA: Scaling Train-time and Inference-time Compute for LLaMA-based Speech Synthesis☆348Jul 21, 2025Updated 7 months ago
- StyleTTS 2: Towards Human-Level Text-to-Speech through Style Diffusion and Adversarial Training with Large Speech Language Models☆6,211Aug 10, 2024Updated last year
- Towards Open-source GPT-4o with Vision, Speech and Duplex Capabilities。☆1,870Jan 16, 2025Updated last year
- A Survey of Spoken Dialogue Models (60 pages)☆315Nov 28, 2024Updated last year
- Amphion (/æmˈfaɪən/) is a toolkit for Audio, Music, and Speech Generation. Its purpose is to support reproducible research and help junio…☆9,716May 27, 2025Updated 9 months ago
- Towards Human-Sounding Speech☆6,016Dec 5, 2025Updated 3 months ago
- Vocos: Closing the gap between time-domain and Fourier-based neural vocoders for high-quality audio synthesis☆1,086Aug 7, 2024Updated last year
- SOTA Open Source TTS☆27,364Mar 13, 2026Updated last week
- An Open Source text-to-speech system built by inverting Whisper.☆4,572Dec 14, 2025Updated 3 months ago
- Ultra-low bitrate neural audio codec (0.31~1.40 kbps) with a better semantic in the latent space.☆247Mar 7, 2025Updated last year
- Controllable and fast Text-to-Speech for over 7000 languages!☆2,191Jan 25, 2026Updated last month
- Build local voice agents with open-source models☆4,602Updated this week
- ☆259Mar 15, 2024Updated 2 years ago
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆62Nov 1, 2024Updated last year
- LLaSA: Scaling Train-time and Inference-time Compute for LLaMA-based Speech Synthesis☆659Jan 21, 2026Updated 2 months ago
- An AI-Powered Speech Processing Toolkit and Open Source SOTA Pretrained Models, Supporting Speech Enhancement, Separation, and Target Spe…☆3,977Aug 14, 2025Updated 7 months ago
- Fast and accurate automatic speech recognition (ASR) for edge devices☆7,391Updated this week
- Open Source framework for voice and multimodal conversational AI☆10,742Updated this week
- Omni SenseVoice: High-Speed Speech Recognition with words timestamps 🗣️🎯☆887Dec 10, 2025Updated 3 months ago
- SpeechGPT Series: Speech Large Language Models☆1,407Jul 22, 2024Updated last year
- Foundational model for human-like, expressive TTS☆4,202Jul 30, 2024Updated last year
- This is the code for the SpeechTokenizer presented in the SpeechTokenizer: Unified Speech Tokenizer for Speech Language Models. Samples a…☆650Jun 9, 2024Updated last year
- Models and code for RepCodec: A Speech Representation Codec for Speech Tokenization☆194Jul 12, 2024Updated last year
- [ICLR 2026] TangoFlux: Super Fast and Faithful Text to Audio Generation with Flow Matching☆843Jan 28, 2026Updated last month
- A family of state-of-the-art Transformer-based audio codecs for low-bitrate high-quality audio coding.☆422Feb 12, 2026Updated last month
- Multi-Scale Neural Audio Codec (SNAC) compresses audio into discrete codes at a low bitrate☆753Nov 19, 2024Updated last year
- PyTorch implementation of Audio Flamingo: Series of Advanced Audio Understanding Language Models☆1,019Dec 15, 2025Updated 3 months ago