Alternatives and similar repositories for Qwen2-Audio:

Users that are interested in Qwen2-Audio are comparing it to the libraries listed below

• QwenLM / Qwen-Audio
  The official repo of Qwen-Audio (通义千问-Audio) chat & pretrained large audio language model proposed by Alibaba Cloud.
  ☆1,637Updated 8 months ago
• THUDM / GLM-4-Voice
  GLM-4-Voice | 端到端中英语音对话模型
  ☆2,787Updated 3 months ago
• FireRedTeam / FireRedASR
  Open-source industrial-grade ASR models supporting Mandarin, Chinese dialects and English, achieving a new SOTA on public Mandarin ASR be…
  ☆797Updated 2 weeks ago
• VITA-MLLM / VITA
  ✨✨VITA-1.5: Towards GPT-4o Level Real-Time Vision and Speech Interaction
  ☆2,167Updated last month
• gpt-omni / mini-omni
  open-source multimodal large language model that can hear, talk while thinking. Featuring real-time end-to-end speech input and streaming…
  ☆3,226Updated 4 months ago
• gpt-omni / mini-omni2
  Towards Open-source GPT-4o with Vision, Speech and Duplex Capabilities。
  ☆1,688Updated 2 months ago
• Tele-AI / TeleSpeech-ASR
  ☆658Updated 9 months ago
• HumanMLLM / R1-Omni
  ☆743Updated this week
• FunAudioLLM / SenseVoice
  Multilingual Voice Understanding Model
  ☆5,025Updated 2 months ago
• THUDM / CogVLM2
  GPT4V-level open-source multi-modal model based on Llama3-8B
  ☆2,315Updated 3 weeks ago
• BytedanceSpeech / seed-tts-eval
  ☆1,215Updated 9 months ago
• LinkSoul-AI / LLaSM
  第一个支持中英文双语语音-文本多模态对话的开源可商用对话模型。便捷的语音输入将大幅改善以文本为输入的大模型的使用体验，同时避免了基于 ASR 解决方案的繁琐流程以及可能引入的错误。
  ☆550Updated last year
• facebookresearch / spiritlm
  Inference code for the paper "Spirit-LM Interleaved Spoken and Written Language Model".
  ☆889Updated 4 months ago
• FunAudioLLM / FunAudioLLM-APP
  ☆345Updated 8 months ago
• X-LANCE / SLAM-LLM
  Speech, Language, Audio, Music Processing with Large Language Model
  ☆757Updated last week
• Henry-23 / VideoChat
  实时语音交互数字人，支持端到端语音方案（GLM-4-Voice - THG）和级联方案（ASR-LLM-TTS-THG）。可自定义形象与音色，无须训练，支持音色克隆，首包延迟低至3s。Real-time voice interactive digital human, su…
  ☆811Updated this week
• VITA-MLLM / Freeze-Omni
  ✨✨Freeze-Omni: A Smart and Low Latency Speech-to-speech Dialogue Model with Frozen LLM
  ☆294Updated 2 months ago
• ictnlp / LLaMA-Omni
  LLaMA-Omni is a low-latency and high-quality end-to-end speech interaction model built upon Llama-3.1-8B-Instruct, aiming to achieve spee…
  ☆2,861Updated 4 months ago
• xinchen-ai / Westlake-Omni
  ☆191Updated 6 months ago
• OpenMOSS / SpeechGPT-2.0-preview
  GPT-4o-level, real-time spoken dialogue system.
  ☆300Updated last month
• FireRedTeam / FireRedTTS
  An Open-Sourced LLM-empowered Foundation TTS System
  ☆635Updated 5 months ago
• zhenye234 / LLaSA_training
  LLaSA: Scaling Train-time and Inference-time Compute for LLaMA-based Speech Synthesis
  ☆473Updated last week
• edwko / OuteTTS
  Interface for OuteTTS models.
  ☆955Updated last month
• FunAudioLLM / InspireMusic
  InspireMusic: A Unified Framework for Music, Song, Audio Generation.
  ☆1,000Updated this week
• infinigence / Infini-Megrez-Omni
  ☆218Updated last month
• ga642381 / speech-trident
  Awesome speech/audio LLMs, representation learning, and codec models
  ☆937Updated last week
• AIDC-AI / Ovis
  A novel Multimodal Large Language Model (MLLM) architecture, designed to structurally align visual and textual embeddings.
  ☆825Updated 3 weeks ago
• ddlBoJack / emotion2vec
  [ACL 2024] Official PyTorch code for extracting features and training downstream models with emotion2vec: Self-Supervised Pre-Training fo…
  ☆767Updated 3 months ago
• ictnlp / StreamSpeech
  StreamSpeech is an “All in One” seamless model for offline and simultaneous speech recognition, speech translation and speech synthesis.
  ☆1,042Updated 7 months ago
• shivammehta25 / Matcha-TTS
  [ICASSP 2024] 🍵 Matcha-TTS: A fast TTS architecture with conditional flow matching
  ☆927Updated 2 weeks ago