xinchen-ai / Westlake-OmniView external linksLinks
☆204Sep 24, 2024Updated last year
Alternatives and similar repositories for Westlake-Omni
Users that are interested in Westlake-Omni are comparing it to the libraries listed below
Sorting:
- ✨✨Freeze-Omni: A Smart and Low Latency Speech-to-speech Dialogue Model with Frozen LLM☆365May 27, 2025Updated 8 months ago
- Baichuan-Audio: A Unified Framework for End-to-End Speech Interaction☆217Feb 28, 2025Updated 11 months ago
- A Survey of Spoken Dialogue Models (60 pages)☆316Nov 28, 2024Updated last year
- Next-generation TTS model using flow-matching and DiT, inspired by Stable Diffusion 3☆433Sep 13, 2024Updated last year
- open-source multimodal large language model that can hear, talk while thinking. Featuring real-time end-to-end speech input and streaming…☆3,524Nov 5, 2024Updated last year
- Ultra-low-bitrate Speech Codec for Speech Language Modeling Applications☆87Dec 20, 2024Updated last year
- The official repository of SpeechCraft dataset, a large-scale expressive bilingual speech dataset with natural language descriptions.☆182Feb 4, 2026Updated 2 weeks ago
- Official Code for ParrotTTS☆58Oct 13, 2024Updated last year
- ☆22Jan 29, 2026Updated 2 weeks ago
- Grapheme-to-Phoneme for Mixed Chinese (Mandarin or Cantonese) and English.☆114Dec 2, 2025Updated 2 months ago
- GLM-4-Voice | 端到端中英语音对话模型☆3,140Dec 5, 2024Updated last year
- Real-time Speech-Text Foundation Model Toolkit (wip)☆252Mar 26, 2025Updated 10 months ago
- ☆177Jul 9, 2024Updated last year
- ☆23Oct 17, 2024Updated last year
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆78Nov 1, 2024Updated last year
- Easy-to-Use Speech MOS predictors☆346Oct 24, 2023Updated 2 years ago
- VoiceBench: Benchmarking LLM-Based Voice Assistants☆331Jan 29, 2026Updated 2 weeks ago
- This repository contains prompts & best practices to annotate audio clips with a very high degree of details using Audio-Language-Models☆35Oct 13, 2024Updated last year
- An evaluation set for large-scale trained TTS models (Coming in Sep 2024)☆12Sep 2, 2024Updated last year
- VoxInstruct: Expressive Human Instruction-to-Speech Generation with Unified Multilingual Codec Language Modelling☆96Nov 9, 2024Updated last year
- VAE modified from Descript Audio Codec, which replaces the RVQ with VAE☆88Apr 2, 2024Updated last year
- Paper, Code and Resources for Speech Language Model and End2End Speech Dialogue System.☆190Nov 10, 2024Updated last year
- MooER: Moore-threads Open Omni model for speech-to-speech intERaction. MooER-omni includes a series of end-to-end speech interaction mode…☆218Jan 8, 2025Updated last year
- OSUM & OSUM-EChat, open speech understanding model and empathetic spoken chatbot based on it, open-sourced by ASLP@NPU.☆480Nov 23, 2025Updated 2 months ago
- GPT-4o-level, real-time spoken dialogue system.☆368Jan 27, 2025Updated last year
- [ACL 2024] Official PyTorch code for extracting features and training downstream models with emotion2vec: Self-Supervised Pre-Training fo…☆1,056Dec 23, 2024Updated last year
- SSR-Speech: Towards Stable, Safe and Robust Zero-shot Speech Editing and Synthesis☆147Jan 1, 2025Updated last year
- Baichuan-Omni: Towards Capable Open-source Omni-modal LLM 🌊☆272Jan 27, 2025Updated last year
- We Speech Transcript based on LLM, in 300 lines of code.☆183Jun 20, 2025Updated 7 months ago
- Reference-aware automatic speech evaluation toolkit☆178Dec 5, 2024Updated last year
- Unofficial pytorch reproduction for the paper "Utilizing Neural Transducers for Two-Stage Text-to-Speech via Semantic Token Prediction" (…☆61Apr 4, 2024Updated last year
- Make-An-Audio-3: Transforming Text/Video into Audio via Flow-based Large Diffusion Transformers☆118May 19, 2025Updated 8 months ago
- FunCodec is a research-oriented toolkit for audio quantization and downstream applications, such as text-to-speech synthesis, music gener…☆441Jan 25, 2024Updated 2 years ago
- A Framework for Speech, Language, Audio, Music Processing with Large Language Model☆972Jan 15, 2026Updated last month
- LLaMA-Omni is a low-latency and high-quality end-to-end speech interaction model built upon Llama-3.1-8B-Instruct, aiming to achieve spee…☆3,123May 19, 2025Updated 8 months ago
- Text-To-Speech for NotebookLM☆39Jul 20, 2025Updated 6 months ago
- [ICASSP 2024] TextrolSpeech: A Text Style Control Speech Corpus With Codec Language Text-to-Speech Models☆183Nov 22, 2024Updated last year
- LibriTTS-P: A Corpus with Speaking Style and Speaker Identity Prompts for Text-to-Speech and Style Captioning☆159Jun 13, 2024Updated last year
- An open-source Kazakh Emotional Text-to-Speech Dataset☆35Aug 1, 2025Updated 6 months ago