Alternatives and similar repositories for Qwen2-Audio:

Users that are interested in Qwen2-Audio are comparing it to the libraries listed below

• QwenLM / Qwen-Audio
  The official repo of Qwen-Audio (通义千问-Audio) chat & pretrained large audio language model proposed by Alibaba Cloud.
  ☆1,665Updated 9 months ago
• FireRedTeam / FireRedASR
  Open-source industrial-grade ASR models supporting Mandarin, Chinese dialects and English, achieving a new SOTA on public Mandarin ASR be…
  ☆899Updated 3 weeks ago
• VITA-MLLM / VITA
  ✨✨VITA-1.5: Towards GPT-4o Level Real-Time Vision and Speech Interaction
  ☆2,225Updated 3 weeks ago
• QwenLM / Qwen2.5-Omni
  Qwen2.5-Omni is an end-to-end multimodal model by Qwen team at Alibaba Cloud, capable of understanding text, audio, vision, video, and pe…
  ☆2,556Updated this week
• DataoceanAI / Dolphin
  Dolphin is a multilingual, multitask ASR model jointly trained by DataoceanAI and Tsinghua University.
  ☆438Updated last week
• gpt-omni / mini-omni
  open-source multimodal large language model that can hear, talk while thinking. Featuring real-time end-to-end speech input and streaming…
  ☆3,279Updated 5 months ago
• Tele-AI / TeleSpeech-ASR
  ☆681Updated 10 months ago
• BytedanceSpeech / seed-tts-eval
  ☆1,259Updated 10 months ago
• THUDM / GLM-4-Voice
  GLM-4-Voice | 端到端中英语音对话模型
  ☆2,841Updated 4 months ago
• HumanMLLM / R1-Omni
  ☆832Updated 3 weeks ago
• facebookresearch / spiritlm
  Inference code for the paper "Spirit-LM Interleaved Spoken and Written Language Model".
  ☆899Updated 5 months ago
• THUDM / CogVLM2
  GPT4V-level open-source multi-modal model based on Llama3-8B
  ☆2,336Updated last month
• FunAudioLLM / SenseVoice
  Multilingual Voice Understanding Model
  ☆5,356Updated 3 weeks ago
• gpt-omni / mini-omni2
  Towards Open-source GPT-4o with Vision, Speech and Duplex Capabilities。
  ☆1,717Updated 3 months ago
• FireRedTeam / FireRedTTS
  An Open-Sourced LLM-empowered Foundation TTS System
  ☆676Updated this week
• FunAudioLLM / FunAudioLLM-APP
  ☆358Updated 8 months ago
• OpenMOSS / SpeechGPT-2.0-preview
  GPT-4o-level, real-time spoken dialogue system.
  ☆314Updated 2 months ago
• VITA-MLLM / Freeze-Omni
  ✨✨Freeze-Omni: A Smart and Low Latency Speech-to-speech Dialogue Model with Frozen LLM
  ☆305Updated 3 months ago
• stepfun-ai / Step-Audio
  ☆4,193Updated last month
• X-LANCE / SLAM-LLM
  Speech, Language, Audio, Music Processing with Large Language Model
  ☆782Updated last week
• shivammehta25 / Matcha-TTS
  [ICASSP 2024] 🍵 Matcha-TTS: A fast TTS architecture with conditional flow matching
  ☆970Updated 2 weeks ago
• infinigence / Infini-Megrez-Omni
  ☆223Updated 2 months ago
• LinkSoul-AI / LLaSM
  第一个支持中英文双语语音-文本多模态对话的开源可商用对话模型。便捷的语音输入将大幅改善以文本为输入的大模型的使用体验，同时避免了基于 ASR 解决方案的繁琐流程以及可能引入的错误。
  ☆553Updated last year
• ga642381 / speech-trident
  Awesome speech/audio LLMs, representation learning, and codec models
  ☆963Updated this week
• Henry-23 / VideoChat
  实时语音交互数字人，支持端到端语音方案（GLM-4-Voice - THG）和级联方案（ASR-LLM-TTS-THG）。可自定义形象与音色，无须训练，支持音色克隆，首包延迟低至3s。Real-time voice interactive digital human, su…
  ☆879Updated last month
• ictnlp / StreamSpeech
  StreamSpeech is an “All in One” seamless model for offline and simultaneous speech recognition, speech translation and speech synthesis.
  ☆1,058Updated 7 months ago
• ictnlp / LLaMA-Omni
  LLaMA-Omni is a low-latency and high-quality end-to-end speech interaction model built upon Llama-3.1-8B-Instruct, aiming to achieve spee…
  ☆2,889Updated 5 months ago
• FunAudioLLM / InspireMusic
  InspireMusic: A Unified Framework for Music, Song, Audio Generation.
  ☆1,056Updated this week
• zhenye234 / LLaSA_training
  LLaSA: Scaling Train-time and Inference-time Compute for LLaMA-based Speech Synthesis
  ☆508Updated last week
• OpenMOSS / AnyGPT
  Code for "AnyGPT: Unified Multimodal LLM with Discrete Sequence Modeling"
  ☆836Updated 7 months ago