Alternatives and similar repositories for speech-to-speech

Users that are interested in speech-to-speech are comparing it to the libraries listed below

• ictnlp / LLaMA-Omni
  LLaMA-Omni is a low-latency and high-quality end-to-end speech interaction model built upon Llama-3.1-8B-Instruct, aiming to achieve spee…
  ☆3,103Updated 7 months ago
• kyutai-labs / moshi
  Moshi is a speech-text foundation model and full-duplex spoken dialogue framework. It uses Mimi, a state-of-the-art streaming neural audi…
  ☆9,184Updated last month
• moonshine-ai / moonshine
  Fast and accurate automatic speech recognition (ASR) for edge devices
  ☆3,042Updated last month
• KoljaB / RealtimeTTS
  Converts text to speech in realtime
  ☆3,675Updated 5 months ago
• Standard-Intelligence / hertz-dev
  first base model for full-duplex conversational audio
  ☆1,771Updated 11 months ago
• fixie-ai / ultravox
  A fast multimodal LLM for real-time voice
  ☆4,296Updated last week
• huggingface / parler-tts
  Inference and training library for high-quality TTS models.
  ☆5,495Updated last year
• edwko / OuteTTS
  Interface for OuteTTS models.
  ☆1,415Updated 6 months ago
• gpt-omni / mini-omni
  open-source multimodal large language model that can hear, talk while thinking. Featuring real-time end-to-end speech input and streaming…
  ☆3,498Updated last year
• Camb-ai / MARS5-TTS
  MARS5 speech model (TTS) from CAMB.AI
  ☆2,809Updated last year
• janhq / ichigo
  Local realtime voice AI
  ☆2,390Updated 3 weeks ago
• speaches-ai / speaches
  ☆2,701Updated this week
• metavoiceio / metavoice-src
  Foundational model for human-like, expressive TTS
  ☆4,197Updated last year
• ufal / whisper_streaming
  Whisper realtime streaming for long speech-to-text transcription and translation
  ☆3,492Updated last month
• canopyai / Orpheus-TTS
  Towards Human-Sounding Speech
  ☆5,828Updated 2 weeks ago
• collabora / WhisperFusion
  WhisperFusion builds upon the capabilities of WhisperLive and WhisperSpeech to provide a seamless conversations with an AI.
  ☆1,643Updated last year
• lhl / voicechat2
  Local SRT/LLM/TTS Voicechat
  ☆745Updated last year
• PromtEngineer / Verbi
  A modular voice assistant application for experimenting with state-of-the-art transcription, response generation, and text-to-speech mode…
  ☆1,085Updated last month
• aiola-lab / whisper-medusa
  Whisper with Medusa heads
  ☆864Updated 4 months ago
• DigitalPhonetics / IMS-Toucan
  Controllable and fast Text-to-Speech for over 7000 languages!
  ☆2,065Updated 5 months ago
• facebookresearch / spiritlm
  Inference code for the paper "Spirit-LM Interleaved Spoken and Written Language Model".
  ☆926Updated last year
• collabora / WhisperLive
  A nearly-live implementation of OpenAI's Whisper.
  ☆3,678Updated 2 months ago
• gradio-app / fastrtc
  The python library for real-time communication
  ☆4,451Updated 3 weeks ago
• yl4579 / StyleTTS2
  StyleTTS 2: Towards Human-Level Text-to-Speech through Style Diffusion and Adversarial Training with Large Speech Language Models
  ☆6,094Updated last year
• kyutai-labs / hibiki
  Hibiki is a model for streaming speech translation (also known as simultaneous translation). Unlike offline translation—where one waits f…
  ☆1,345Updated 8 months ago
• huggingface / distil-whisper
  Distilled variant of Whisper for speech recognition. 6x faster, 50% smaller, within 1% word error rate.
  ☆4,004Updated 11 months ago
• WhisperSpeech / WhisperSpeech
  An Open Source text-to-speech system built by inverting Whisper.
  ☆4,540Updated last week
• myshell-ai / MeloTTS
  High-quality multi-lingual text-to-speech library by MyShell.ai. Support English, Spanish, French, Chinese, Japanese and Korean.
  ☆7,065Updated 11 months ago
• zai-org / GLM-4-Voice
  GLM-4-Voice | 端到端中英语音对话模型
  ☆3,103Updated last year
• pipecat-ai / pipecat
  Open Source framework for voice and multimodal conversational AI
  ☆9,445Updated this week