Alternatives and similar repositories for SpeechAgents

Users that are interested in SpeechAgents are comparing it to the libraries listed below

• XiaomiMiMo / MiMo-Audio-Eval
  ☆70Updated 2 months ago
• Lollipop / Qwen2-Audio
  The official repo of Qwen2-Audio chat & pretrained large audio language model proposed by Alibaba Cloud.
  ☆37Updated last year
• sanowl / LSLM-Listening-while-Speaking-Language-Model
  LSLM implements full duplex modeling in interactive speech language models, based on research by Ma et al. (2024). This project advances …
  ☆83Updated 5 months ago
• jingzhunxue / flow_mirror
  flow mirror models from JZX AI Labs
  ☆43Updated last year
• TouchSky-Lab / Awesome-Text-to-Speech-TTS
  Awesome TTS
  ☆61Updated 4 years ago
• thunlp / duplex-model
  ☆42Updated last year
• shuaijiang / Ke-Omni-R
  Ke-Omni-R is an advanced audio reasoning model and achieved SOTA on MMAU
  ☆54Updated 6 months ago
• multimodal-art-projection / OmniBench
  A project for tri-modal LLM benchmarking and instruction tuning.
  ☆52Updated 8 months ago
• CASIA-LM / OpenS2S
  OpenS2S : Advancing Fully Open-Source End-to-End Empathetic Large Speech Language Model
  ☆96Updated 4 months ago
• AI-S2-Lab / EmoPP
  [NCMMSC'2024] Emotion-Aware Prosodic Phrasing for Expressive Text-to-Speech
  ☆22Updated last year
• OpenBMB / UltraEval-Audio
  Your faithful, impartial partner for audio evaluation — know yourself and your rivals.真实评测，知己知彼。
  ☆175Updated last week
• EIT-NLP / LLaSO
  ☆109Updated last month
• FreedomIntelligence / FusionAudio
  Towards Fine-grained Audio Captioning with Multimodal Contextual Cues
  ☆85Updated 2 months ago
• Jack-ZC8 / M3AV-dataset
  [ACL 2024] A Multimodal, Multigenre, and Multipurpose Audio-Visual Academic Lecture Dataset
  ☆19Updated 6 months ago
• Haoqiu-Yan / PerceptiveAgent
  Code for Talk With Human-like Agents: Empathetic Dialogue Through Perceptible Acoustic Reception and Reaction (ACL24))
  ☆48Updated last year
• DAMO-NLP-SG / SeaLLMs-Audio
  ☆50Updated this week
• baichuan-inc / Baichuan-Omni-1.5
  ☆182Updated 10 months ago
• westlake-baichuan-mllm / bc-omni
  Baichuan-Omni: Towards Capable Open-source Omni-modal LLM 🌊
  ☆272Updated 10 months ago
• ictnlp / LLaMA-Omni2
  ☆250Updated 6 months ago
• HumanMLLM / CoGenAV
  ☆61Updated 5 months ago
• cwang621 / blsp-emo
  BLSP-Emo: Towards Empathetic Large Speech-Language Models
  ☆55Updated last year
• OmniMMI / OpenOmniNexus
  a fully open-source implementation of a GPT-4o-like speech-to-speech video understanding model.
  ☆35Updated 8 months ago
• jianganbai / FISHER
  A Foundation Model for Industrial Signal Comprehensive Representation
  ☆54Updated 4 months ago
• FreedomIntelligence / EchoX
  EchoX: Towards Mitigating Acoustic-Semantic Gap via Echo Training for Speech-to-Speech LLMs
  ☆42Updated 2 months ago
• ictnlp / DASpeech
  Code for NeurIPS 2023 paper "DASpeech: Directed Acyclic Transformer for Fast and High-quality Speech-to-Speech Translation".
  ☆63Updated last year
• ictnlp / NAST-S2x
  A fast speech-to-speech & speech-to-text translation model that supports simultaneous decoding and offers 28× speedup.
  ☆77Updated last year
• OFA-Sys / AIR-Bench
  AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension
  ☆124Updated last year
• boson-ai / EmergentTTS-Eval-public
  [NeurIPS' 25] Benchmark for evaluating TTS models on complex prosodic, expressiveness, and linguistic challenges.
  ☆179Updated this week
• MiniMax-AI / audio-tools
  A collection of optimized utilities for text-to-audio processing, enhancing both training and inference workflows. This repository contai…
  ☆41Updated 8 months ago
• Sakshi113 / MMAU
  ☆121Updated 3 months ago