Alternatives and similar repositories for speech-to-speech

Users that are interested in speech-to-speech are comparing it to the libraries listed below

• ictnlp / LLaMA-Omni
  LLaMA-Omni is a low-latency and high-quality end-to-end speech interaction model built upon Llama-3.1-8B-Instruct, aiming to achieve spee…
  ☆3,114Updated 7 months ago
• fixie-ai / ultravox
  A fast multimodal LLM for real-time voice
  ☆4,309Updated last month
• huggingface / parler-tts
  Inference and training library for high-quality TTS models.
  ☆5,505Updated last year
• moonshine-ai / moonshine
  Fast and accurate automatic speech recognition (ASR) for edge devices
  ☆3,065Updated last month
• kyutai-labs / moshi
  Moshi is a speech-text foundation model and full-duplex spoken dialogue framework. It uses Mimi, a state-of-the-art streaming neural audi…
  ☆9,250Updated last month
• KoljaB / RealtimeTTS
  Converts text to speech in realtime
  ☆3,704Updated 5 months ago
• janhq / ichigo
  Local realtime voice AI
  ☆2,426Updated last month
• Standard-Intelligence / hertz-dev
  first base model for full-duplex conversational audio
  ☆1,769Updated last year
• facebookresearch / spiritlm
  Inference code for the paper "Spirit-LM Interleaved Spoken and Written Language Model".
  ☆926Updated last year
• Camb-ai / MARS5-TTS
  MARS5 speech model (TTS) from CAMB.AI
  ☆2,810Updated last year
• ufal / whisper_streaming
  Whisper realtime streaming for long speech-to-text transcription and translation
  ☆3,509Updated 2 months ago
• gpt-omni / mini-omni
  open-source multimodal large language model that can hear, talk while thinking. Featuring real-time end-to-end speech input and streaming…
  ☆3,509Updated last year
• metavoiceio / metavoice-src
  Foundational model for human-like, expressive TTS
  ☆4,196Updated last year
• lhl / voicechat2
  Local SRT/LLM/TTS Voicechat
  ☆748Updated last year
• gradio-app / fastrtc
  The python library for real-time communication
  ☆4,483Updated last month
• edwko / OuteTTS
  Interface for OuteTTS models.
  ☆1,419Updated 6 months ago
• WhisperSpeech / WhisperSpeech
  An Open Source text-to-speech system built by inverting Whisper.
  ☆4,550Updated 3 weeks ago
• pipecat-ai / pipecat
  Open Source framework for voice and multimodal conversational AI
  ☆9,716Updated this week
• aiola-lab / whisper-medusa
  Whisper with Medusa heads
  ☆864Updated 5 months ago
• collabora / WhisperLive
  A nearly-live implementation of OpenAI's Whisper.
  ☆3,721Updated 3 months ago
• DigitalPhonetics / IMS-Toucan
  Controllable and fast Text-to-Speech for over 7000 languages!
  ☆2,143Updated 6 months ago
• collabora / WhisperFusion
  WhisperFusion builds upon the capabilities of WhisperLive and WhisperSpeech to provide a seamless conversations with an AI.
  ☆1,643Updated last year
• speaches-ai / speaches
  ☆2,780Updated this week
• huggingface / distil-whisper
  Distilled variant of Whisper for speech recognition. 6x faster, 50% smaller, within 1% word error rate.
  ☆4,015Updated last year
• yl4579 / StyleTTS2
  StyleTTS 2: Towards Human-Level Text-to-Speech through Style Diffusion and Adversarial Training with Large Speech Language Models
  ☆6,110Updated last year
• canopyai / Orpheus-TTS
  Towards Human-Sounding Speech
  ☆5,868Updated last month
• kyutai-labs / hibiki
  Hibiki is a model for streaming speech translation (also known as simultaneous translation). Unlike offline translation—where one waits f…
  ☆1,351Updated 8 months ago
• pipecat-ai / smart-turn
  ☆1,205Updated this week
• zai-org / GLM-4-Voice
  GLM-4-Voice | 端到端中英语音对话模型
  ☆3,111Updated last year
• QwenLM / Qwen2-Audio
  The official repo of Qwen2-Audio chat & pretrained large audio language model proposed by Alibaba Cloud.
  ☆2,025Updated 8 months ago