Alternatives and similar repositories for speech-to-speech:

Users that are interested in speech-to-speech are comparing it to the libraries listed below

• fixie-ai / ultravox
  A fast multimodal LLM for real-time voice
  ☆2,760Updated this week
• ictnlp / LLaMA-Omni
  LLaMA-Omni is a low-latency and high-quality end-to-end speech interaction model built upon Llama-3.1-8B-Instruct, aiming to achieve spee…
  ☆2,746Updated 2 months ago
• kyutai-labs / moshi
  ☆7,156Updated this week
• huggingface / parler-tts
  Inference and training library for high-quality TTS models.
  ☆4,910Updated last month
• usefulsensors / moonshine
  Fast and accurate automatic speech recognition (ASR) for edge devices
  ☆2,492Updated this week
• Standard-Intelligence / hertz-dev
  first base model for full-duplex conversational audio
  ☆1,669Updated last week
• pipecat-ai / pipecat
  Open Source framework for voice and multimodal conversational AI
  ☆4,299Updated this week
• janhq / ichigo
  Local realtime voice AI
  ☆2,162Updated this week
• gpt-omni / mini-omni
  open-source multimodal large language model that can hear, talk while thinking. Featuring real-time end-to-end speech input and streaming…
  ☆3,066Updated 2 months ago
• livekit / agents
  Build real-time multimodal AI applications 🤖🎙️📹
  ☆4,588Updated this week
• edwko / OuteTTS
  Interface for OuteTTS models.
  ☆859Updated this week
• collabora / WhisperFusion
  WhisperFusion builds upon the capabilities of WhisperLive and WhisperSpeech to provide a seamless conversations with an AI.
  ☆1,570Updated 5 months ago
• run-llama / llama_parse
  Parse files for optimal RAG
  ☆3,526Updated last week
• pytorch / torchchat
  Run PyTorch LLMs locally on servers, desktop and mobile
  ☆3,462Updated this week
• THUDM / GLM-4-Voice
  GLM-4-Voice | 端到端中英语音对话模型
  ☆2,565Updated last month
• modelscope / ClearerVoice-Studio
  An AI-Powered Speech Processing Toolkit and Open Source SOTA Pretrained Models, Supporting Speech Enhancement, Separation, and Target Spe…
  ☆2,014Updated this week
• huggingface / smolagents
  🤗 smolagents: a barebones library for agents. Agents write python code to call tools and orchestrate other agents.
  ☆5,197Updated this week
• gabrielchua / open-notebooklm
  Convert any PDF into a podcast episode!
  ☆1,816Updated last month
• langchain-ai / open-canvas
  📃 A better UX for chat, writing content, and coding with LLMs.
  ☆3,443Updated 2 weeks ago
• facebookresearch / spiritlm
  Inference code for the paper "Spirit-LM Interleaved Spoken and Written Language Model".
  ☆863Updated 2 months ago
• lm-sys / RouteLLM
  A framework for serving and evaluating LLM routers - save LLM costs without compromising quality
  ☆3,442Updated 5 months ago
• PromtEngineer / Verbi
  A modular voice assistant application for experimenting with state-of-the-art transcription, response generation, and text-to-speech mode…
  ☆866Updated 2 months ago
• NovaSky-AI / SkyThought
  Sky-T1: Train your own O1 preview model within $450
  ☆1,795Updated this week
• lhl / voicechat2
  Local SRT/LLM/TTS Voicechat
  ☆590Updated 3 months ago
• QwenLM / Qwen2-Audio
  The official repo of Qwen2-Audio chat & pretrained large audio language model proposed by Alibaba Cloud.
  ☆1,395Updated 5 months ago
• aiola-lab / whisper-medusa
  Whisper with Medusa heads
  ☆818Updated 2 weeks ago
• souzatharsis / podcastfy
  An Open Source Python alternative to NotebookLM's podcast feature: Transforming Multimodal Content into Captivating Multilingual Audio Co…
  ☆2,413Updated last week
• meta-llama / llama-stack
  Composable building blocks to build Llama Apps
  ☆6,036Updated this week
• huggingface / smollm
  Everything about the SmolLM & SmolLM2 family of models
  ☆1,554Updated last week
• chonkie-ai / chonkie
  🦛 CHONK your texts with Chonkie ✨ - The no-nonsense RAG chunking library
  ☆2,249Updated this week