Alternatives and similar repositories for Step-Audio:

Users that are interested in Step-Audio are comparing it to the libraries listed below

• stepfun-ai / Step-Video-T2V
  ☆2,734Updated 2 weeks ago
• THUDM / GLM-4-Voice
  GLM-4-Voice | 端到端中英语音对话模型
  ☆2,801Updated 3 months ago
• FunAudioLLM / SenseVoice
  Multilingual Voice Understanding Model
  ☆5,121Updated last week
• QwenLM / Qwen2.5-Omni
  Qwen2.5-Omni is an end-to-end multimodal model by Qwen team at Alibaba Cloud, capable of understanding text, audio, vision, video, and pe…
  ☆1,076Updated this week
• bytedance / LatentSync
  Taming Stable Diffusion for Lip Sync!
  ☆3,317Updated last week
• FunAudioLLM / CosyVoice
  Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.
  ☆12,413Updated last week
• gpt-omni / mini-omni
  open-source multimodal large language model that can hear, talk while thinking. Featuring real-time end-to-end speech input and streaming…
  ☆3,239Updated 4 months ago
• antgroup / echomimic_v2
  [CVPR 2025] EchoMimicV2: Towards Striking, Simplified, and Semi-Body Human Animation
  ☆3,382Updated last month
• Plachtaa / seed-vc
  zero-shot voice conversion & singing voice conversion, with real-time support
  ☆2,095Updated last week
• SkyworkAI / SkyReels-V1
  SkyReels V1: The first and most advanced open-source human-centric video foundation model
  ☆1,915Updated 3 weeks ago
• FunAudioLLM / InspireMusic
  InspireMusic: A Unified Framework for Music, Song, Audio Generation.
  ☆1,010Updated last week
• jixiaozhong / Sonic
  Official implementation of "Sonic: Shifting Focus to Global Audio Perception in Portrait Animation"
  ☆2,225Updated 2 weeks ago
• modelscope / ClearerVoice-Studio
  An AI-Powered Speech Processing Toolkit and Open Source SOTA Pretrained Models, Supporting Speech Enhancement, Separation, and Target Spe…
  ☆2,476Updated this week
• QwenLM / Qwen2-Audio
  The official repo of Qwen2-Audio chat & pretrained large audio language model proposed by Alibaba Cloud.
  ☆1,634Updated 7 months ago
• BytedanceSpeech / seed-tts-eval
  ☆1,224Updated 9 months ago
• SparkAudio / Spark-TTS
  Spark-TTS Inference Code
  ☆6,962Updated last week
• FireRedTeam / FireRedASR
  Open-source industrial-grade ASR models supporting Mandarin, Chinese dialects and English, achieving a new SOTA on public Mandarin ASR be…
  ☆832Updated this week
• GuijiAI / HeyGem.ai
  ☆5,059Updated this week
• VITA-MLLM / VITA
  ✨✨VITA-1.5: Towards GPT-4o Level Real-Time Vision and Speech Interaction
  ☆2,179Updated last month
• FireRedTeam / FireRedTTS
  An Open-Sourced LLM-empowered Foundation TTS System
  ☆647Updated 5 months ago
• libukai / Awesome-ChatTTS
  官方推荐的 ChatTTS 资源汇总项目，整理了全网相关资源和常见问题 || Officially recommended ChatTTS resource collection project
  ☆1,576Updated 8 months ago
• HumanMLLM / R1-Omni
  ☆766Updated last week
• ASLP-lab / DiffRhythm
  Di♪♪Rhythm: Blazingly Fast and Embarrassingly Simple End-to-End Full-Length Song Generation with Latent Diffusion
  ☆1,351Updated this week
• antgroup / echomimic
  [AAAI 2025] EchoMimic: Lifelike Audio-Driven Portrait Animations through Editable Landmark Conditioning
  ☆3,728Updated 3 months ago
• Kedreamix / Linly-Talker
  Digital Avatar Conversational System - Linly-Talker. 😄✨ Linly-Talker is an intelligent AI system that combines large language models (LL…
  ☆2,518Updated last month
• Kiln-AI / Kiln
  The easiest tool for fine-tuning LLM models, synthetic data generation, and collaborating on datasets.
  ☆3,264Updated this week
• wwbin2017 / bailing
  百聆 是一个类似GPT-4o的语音对话机器人，通过ASR+LLM+TTS实现，集成DeepSeek R1等优秀大模型，时延低至800ms，Mac等低配置也可运行，支持打断
  ☆997Updated 2 weeks ago
• Saiyan-World / goku
  Video Generation Foundation Models: https://saiyan-world.github.io/goku/
  ☆2,755Updated last month
• SWivid / F5-TTS
  Official code for "F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matching"
  ☆10,821Updated this week
• bytedance / MegaTTS3
  ☆468Updated this week