☆203Sep 24, 2024Updated last year
Alternatives and similar repositories for Westlake-Omni
Users that are interested in Westlake-Omni are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ✨✨Freeze-Omni: A Smart and Low Latency Speech-to-speech Dialogue Model with Frozen LLM☆385May 27, 2025Updated last year
- A Survey of Spoken Dialogue Models (60 pages)☆317Nov 28, 2024Updated last year
- Baichuan-Audio: A Unified Framework for End-to-End Speech Interaction☆223Feb 28, 2025Updated last year
- ☆24Jun 10, 2026Updated 2 weeks ago
- open-source multimodal large language model that can hear, talk while thinking. Featuring real-time end-to-end speech input and streaming…☆3,562Nov 5, 2024Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Grapheme-to-Phoneme for Mixed Chinese (Mandarin or Cantonese) and English.☆115Dec 2, 2025Updated 6 months ago
- Next-generation TTS model using flow-matching and DiT, inspired by Stable Diffusion 3☆437Sep 13, 2024Updated last year
- GLM-4-Voice | 端到端中英语音对话模型☆3,195Dec 5, 2024Updated last year
- This repository contains prompts & best practices to annotate audio clips with a very high degree of details using Audio-Language-Models☆35Oct 13, 2024Updated last year
- [TACL'26] VoiceBench: Benchmarking LLM-Based Voice Assistants☆371Jun 11, 2026Updated 2 weeks ago
- Ultra-low-bitrate Speech Codec for Speech Language Modeling Applications☆92Dec 20, 2024Updated last year
- LLaMA-Omni is a low-latency and high-quality end-to-end speech interaction model built upon Llama-3.1-8B-Instruct, aiming to achieve spee…☆3,140May 19, 2025Updated last year
- The official repository of SpeechCraft dataset, a large-scale expressive bilingual speech dataset with natural language descriptions.☆193Feb 28, 2026Updated 4 months ago
- Paper, Code and Resources for Speech Language Model and End2End Speech Dialogue System.☆201Jun 7, 2026Updated 3 weeks ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Real-time Speech-Text Foundation Model Toolkit (wip)☆257Mar 26, 2025Updated last year
- GPT-4o-level, real-time spoken dialogue system.☆376Jan 27, 2025Updated last year
- Baichuan-Omni: Towards Capable Open-source Omni-modal LLM 🌊☆273Jan 27, 2025Updated last year
- VAE modified from Descript Audio Codec, which replaces the RVQ with VAE☆92Apr 2, 2024Updated 2 years ago
- ☆181Jul 9, 2024Updated last year
- Easy-to-Use Speech MOS predictors☆358Oct 24, 2023Updated 2 years ago
- A streaming audio reader, processor, and writer built on top of soundfile, and PyAV (bindings for FFmpeg)☆39Mar 31, 2026Updated 2 months ago
- We Speech Transcript based on LLM, in 300 lines of code.☆185Jun 20, 2025Updated last year
- MooER: Moore-threads Open Omni model for speech-to-speech intERaction. MooER-omni includes a series of end-to-end speech interaction mode…☆222Jan 8, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Official Code for ParrotTTS☆58Oct 13, 2024Updated last year
- ☆23Oct 17, 2024Updated last year
- Make-An-Audio-3: Transforming Text/Video into Audio via Flow-based Large Diffusion Transformers☆121May 19, 2025Updated last year
- Unofficial pytorch reproduction for the paper "Utilizing Neural Transducers for Two-Stage Text-to-Speech via Semantic Token Prediction" (…☆60Apr 4, 2024Updated 2 years ago
- [ACL 2024] Official PyTorch code for extracting features and training downstream models with emotion2vec: Self-Supervised Pre-Training fo…☆1,148Dec 23, 2024Updated last year
- OSUM & OSUM-EChat, open speech understanding model and empathetic spoken chatbot based on it, open-sourced by ASLP@NPU.☆496Nov 23, 2025Updated 7 months ago
- VoxInstruct: Expressive Human Instruction-to-Speech Generation with Unified Multilingual Codec Language Modelling☆100Nov 9, 2024Updated last year
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆78Nov 1, 2024Updated last year
- ☆854Jun 7, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A Framework for Speech, Language, Audio, Music Processing with Large Language Model☆1,039Jan 15, 2026Updated 5 months ago
- ✨✨[NeurIPS 2025] VITA-1.5: Towards GPT-4o Level Real-Time Vision and Speech Interaction☆2,519Mar 28, 2025Updated last year
- FunCodec is a research-oriented toolkit for audio quantization and downstream applications, such as text-to-speech synthesis, music gener…☆443Jan 25, 2024Updated 2 years ago
- Text-To-Speech for NotebookLM☆39Jul 20, 2025Updated 11 months ago
- LibriTTS-P: A Corpus with Speaking Style and Speaker Identity Prompts for Text-to-Speech and Style Captioning☆161Jun 13, 2024Updated 2 years ago
- A pitch detection model trained to be robust against noise and reverberation environments.☆27Jan 21, 2025Updated last year
- [EMNLP 2025 Findings] A complete cross-modal RAG system for end-to-end speech-to-speech large models, including ASR-based Retrieval and E…☆31Jul 11, 2025Updated 11 months ago