Alternatives and similar repositories for OpenS2S

Users that are interested in OpenS2S are comparing it to the libraries listed below

• EIT-NLP / LLaSO
  ☆104Updated last month
• OpenBMB / UltraEval-Audio
  An easy-to-use, fast, and easily integrable tool for evaluating audio LLM
  ☆165Updated 3 weeks ago
• baichuan-inc / Baichuan-Audio
  Baichuan-Audio: A Unified Framework for End-to-End Speech Interaction
  ☆216Updated 8 months ago
• shuaijiang / Ke-Omni-R
  Ke-Omni-R is an advanced audio reasoning model and achieved SOTA on MMAU
  ☆55Updated 5 months ago
• JimmyMa99 / train-higgs-audio
  Text-audio foundation model from Boson AI
  ☆112Updated 2 months ago
• VITA-MLLM / LUCY
  LUCY: Linguistic Understanding and Control Yielding Early Stage of Her
  ☆55Updated 7 months ago
• GiantAILab / DiaMoE-TTS
  Official code for"DiaMoE-TTS: A Unified IPA-based Dialect TTS Framework with Mixture-of-Experts and Parameter-Efficient Zero-Shot Adaptat…
  ☆176Updated 2 weeks ago
• XiaomiMiMo / MiMo-Audio-Tokenizer
  A unified tokenizer that is capable of both extracting semantic information and enabling high-fidelity audio reconstruction.
  ☆115Updated 2 months ago
• cwang621 / blsp-emo
  BLSP-Emo: Towards Empathetic Large Speech-Language Models
  ☆53Updated last year
• OpenMOSS / MOSS-Speech
  MOSS-Speech is a true speech-to-speech large language model without text guidance.
  ☆64Updated last month
• pengzhendong / streaming-ChatTTS
  ☆23Updated last year
• boson-ai / EmergentTTS-Eval-public
  [NeurIPS' 25] Benchmark for evaluating TTS models on complex prosodic, expressiveness, and linguistic challenges.
  ☆176Updated last month
• ictnlp / SLED-TTS
  Streamable Text-to-Speech model using a language modeling approach, without vector quantization
  ☆103Updated 6 months ago
• yanghaha0908 / EmoVoice
  Official code for "EmoVoice: LLM-based Emotional Text-To-Speech Model with Freestyle Text Prompting"
  ☆93Updated last month
• LAION-AI / emotion-annotations
  ☆102Updated last month
• SparkAudio / VoxBox
  A large-scale speech corpus introduced in Spark-TTS, built from diverse open-source datasets for training text-to-speech (TTS) systems.
  ☆95Updated 6 months ago
• xingchensong / FlashCosyVoice
  FlashCosyVoice: A lightweight vLLM implementation built from scratch for CosyVoice.
  ☆210Updated last week
• SJTU-OmniAgent / VocalNet
  ☆104Updated 2 months ago
• wntg / LLaMA-Omni
  llama-omni训练代码复现
  ☆69Updated 9 months ago
• walker-hyf / GPT-Talker
  Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)
  ☆76Updated last year
• yynil / RWKVTTS
  This project is to train an RWKV LLM for TTS generation which compatible to other TTS engine(like fish/cosy/chattts).
  ☆88Updated last month
• ictnlp / NAST-S2x
  A fast speech-to-speech & speech-to-text translation model that supports simultaneous decoding and offers 28× speedup.
  ☆77Updated last year
• ictnlp / ComSpeech
  Code for ACL 2024 main conference paper "Can We Achieve High-quality Direct Speech-to-Speech Translation Without Parallel Speech Data?".
  ☆25Updated last year
• FunAudioLLM / CV3-Eval
  ☆139Updated 2 months ago
• xingchensong / TouchNet
  A native-PyTorch library for large scale M-LLM (text/audio) training with tp/cp/dp.
  ☆221Updated 3 months ago
• XiaomiMiMo / MiMo-Audio-Training
  ☆85Updated last month
• ydqmkkx / ShallowFlowMatching-TTS
  Official implementation of paper: Shallow Flow Matching for Coarse-to-Fine Text-to-Speech Synthesis
  ☆45Updated 2 months ago
• amphionspace / SD-Eval
  [NeurIPS 2024] SD-Eval: A Benchmark Dataset for Spoken Dialogue Understanding Beyond Words
  ☆53Updated last year
• MoonshotAI / Kimi-Audio-Evalkit
  ☆148Updated 3 months ago
• FrontierLabs / F5R-TTS
  Official code for "F5R-TTS: Improving Flow-Matching based Text-to-Speech with Group Relative Policy Optimization"
  ☆127Updated 5 months ago