0nutation / SpeechAgentsLinks
SpeechAgents: Human-Communication Simulation with Multi-Modal Multi-Agent Systems
☆83Updated last year
Alternatives and similar repositories for SpeechAgents
Users that are interested in SpeechAgents are comparing it to the libraries listed below
Sorting:
- The official repo of Qwen2-Audio chat & pretrained large audio language model proposed by Alibaba Cloud.☆37Updated last year
- flow mirror models from JZX AI Labs☆44Updated 11 months ago
- OpenS2S : Advancing Fully Open-Source End-to-End Empathetic Large Speech Language Model☆83Updated 2 months ago
- LSLM implements full duplex modeling in interactive speech language models, based on research by Ma et al. (2024). This project advances …☆75Updated 2 months ago
- An easy-to-use, fast, and easily integrable tool for evaluating audio LLM☆142Updated last month
- ☆35Updated last week
- Awesome TTS☆60Updated 4 years ago
- Ke-Omni-R is an advanced audio reasoning model and achieved SOTA on MMAU☆47Updated 3 months ago
- Code for Talk With Human-like Agents: Empathetic Dialogue Through Perceptible Acoustic Reception and Reaction (ACL24))☆45Updated last year
- EchoX: Towards Mitigating Acoustic-Semantic Gap via Echo Training for Speech-to-Speech LLMs☆28Updated last week
- A project for tri-modal LLM benchmarking and instruction tuning.☆47Updated 5 months ago
- [NCMMSC'2024] Emotion-Aware Prosodic Phrasing for Expressive Text-to-Speech☆22Updated last year
- BLSP-Emo: Towards Empathetic Large Speech-Language Models☆49Updated last year
- ☆40Updated last year
- Code for NeurIPS 2023 paper "DASpeech: Directed Acyclic Transformer for Fast and High-quality Speech-to-Speech Translation".☆63Updated last year
- ☆12Updated last year
- A Foundation Model for Industrial Signal Comprehensive Representation☆40Updated last month
- ☆228Updated 4 months ago
- ☆172Updated 7 months ago
- Towards Fine-grained Audio Captioning with Multimodal Contextual Cues☆80Updated 3 months ago
- [ACL 2024] A Multimodal, Multigenre, and Multipurpose Audio-Visual Academic Lecture Dataset☆18Updated 3 months ago
- A fast speech-to-speech & speech-to-text translation model that supports simultaneous decoding and offers 28× speedup.☆75Updated 10 months ago
- A collection of optimized utilities for text-to-audio processing, enhancing both training and inference workflows. This repository contai…☆39Updated 5 months ago
- a fully open-source implementation of a GPT-4o-like speech-to-speech video understanding model.☆26Updated 5 months ago
- ☆48Updated last month
- Benchmark for evaluating TTS models on complex prosodic, expressiveness, and linguistic challenges.☆154Updated last month
- ☆108Updated 2 weeks ago
- AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension☆116Updated 9 months ago
- Baichuan-Audio: A Unified Framework for End-to-End Speech Interaction☆209Updated 6 months ago
- Baichuan-Omni: Towards Capable Open-source Omni-modal LLM 🌊☆269Updated 7 months ago