Alternatives and similar repositories for SpeechAgents:

Users that are interested in SpeechAgents are comparing it to the libraries listed below

• jingzhunxue / flow_mirror
  flow mirror models from JZX AI Labs
  ☆43Updated 3 months ago
• Jack-ZC8 / M3AV-dataset
  [ACL 2024] A Multimodal, Multigenre, and Multipurpose Audio-Visual Academic Lecture Dataset
  ☆13Updated 3 months ago
• 0nutation / SpeechGPT2.github.io
  ☆12Updated 5 months ago
• cwang621 / blsp-emo
  BLSP-Emo: Towards Empathetic Large Speech-Language Models
  ☆41Updated 7 months ago
• Lollipop / Qwen2-Audio
  The official repo of Qwen2-Audio chat & pretrained large audio language model proposed by Alibaba Cloud.
  ☆28Updated 4 months ago
• sanowl / LSLM-Listening-while-Speaking-Language-Model
  LSLM implements full duplex modeling in interactive speech language models, based on research by Ma et al. (2024). This project advances …
  ☆59Updated 3 weeks ago
• zruiii / QwenAudioSFT
  The repoduction codes for Qwen-Audio Fine-tuning
  ☆26Updated 5 months ago
• OFA-Sys / AIR-Bench
  AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension
  ☆69Updated last month
• thunlp / duplex-model
  ☆33Updated 5 months ago
• Haoqiu-Yan / PerceptiveAgent
  Code for Talk With Human-like Agents: Empathetic Dialogue Through Perceptible Acoustic Reception and Reaction (ACL24))
  ☆40Updated 5 months ago
• westlake-baichuan-mllm / bc-omni
  Baichuan-Omni: Towards Capable Open-source Omni-modal LLM 🌊
  ☆258Updated 2 months ago
• ictnlp / DASpeech
  Code for NeurIPS 2023 paper "DASpeech: Directed Acyclic Transformer for Fast and High-quality Speech-to-Speech Translation".
  ☆61Updated 5 months ago
• cooper12121 / llama3-8x8b-MoE
  Copy the MLP of llama3 8 times as 8 experts , created a router with random initialization,add load balancing loss to construct an 8x8b Mo…
  ☆26Updated 6 months ago
• emo-box / EmoBox
  [INTERSPEECH 2024] EmoBox: Multilingual Multi-corpus Speech Emotion Recognition Toolkit and Benchmark
  ☆189Updated 7 months ago
• ddlBoJack / Awesome-Speech-Language-Model
  Paper, Code and Resources for Speech Language Model and End2End Speech Dialogue System.
  ☆147Updated 2 months ago
• TouchSky-Lab / Awesome-Text-to-Speech-TTS
  Awesome TTS
  ☆54Updated 3 years ago
• bytedance / Make-An-Audio-2
  a text-conditional diffusion probabilistic model capable of generating high fidelity audio.
  ☆138Updated 7 months ago
• VITA-MLLM / Freeze-Omni
  ✨✨Freeze-Omni: A Smart and Low Latency Speech-to-speech Dialogue Model with Frozen LLM
  ☆255Updated 2 weeks ago
• vaew / SkyScript-100M
  SkyScript-100M: 1,000,000,000 Pairs of Scripts and Shooting Scripts for Short Drama: https://arxiv.org/abs/2408.09333v2
  ☆109Updated 2 months ago
• RhapsodyAILab / MiniCPM-V-Embedding
  ☆26Updated 5 months ago
• ictnlp / NAST-S2x
  A fast speech-to-speech & speech-to-text translation model that supports simultaneous decoding and offers 28× speedup.
  ☆63Updated 2 months ago
• MatthewCYM / VoiceBench
  VoiceBench: Benchmarking LLM-Based Voice Assistants
  ☆90Updated this week
• 18907305772 / FuseAI
  FuseAI Project
  ☆76Updated last month
• AudioLLMs / AudioBench
  AudioBench: A Universal Benchmark for Audio Large Language Models
  ☆109Updated this week
• walker-hyf / GPT-Talker
  Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)
  ☆60Updated 2 months ago
• chenpk00 / IS2024_stream_decoder_only_asr
  ☆12Updated 10 months ago
• AI-S2-Lab / EmoPP
  [NCMMSC'2024] Emotion-Aware Prosodic Phrasing for Expressive Text-to-Speech
  ☆22Updated 4 months ago
• ictnlp / ComSpeech
  Code for ACL 2024 main conference paper "Can We Achieve High-quality Direct Speech-to-Speech Translation Without Parallel Speech Data?".
  ☆24Updated 6 months ago
• DanielLin94144 / StyleTalk
  Official release of StyleTalk dataset.
  ☆60Updated 6 months ago