0nutation / SpeechAgentsLinks
SpeechAgents: Human-Communication Simulation with Multi-Modal Multi-Agent Systems
☆84Updated last year
Alternatives and similar repositories for SpeechAgents
Users that are interested in SpeechAgents are comparing it to the libraries listed below
Sorting:
- The official repo of Qwen2-Audio chat & pretrained large audio language model proposed by Alibaba Cloud.☆37Updated last year
- flow mirror models from JZX AI Labs☆44Updated last year
- LSLM implements full duplex modeling in interactive speech language models, based on research by Ma et al. (2024). This project advances …☆81Updated 4 months ago
- An easy-to-use, fast, and easily integrable tool for evaluating audio LLM☆158Updated this week
- A project for tri-modal LLM benchmarking and instruction tuning.☆48Updated 7 months ago
- ☆66Updated last month
- Awesome TTS☆60Updated 4 years ago
- ☆103Updated last week
- OpenS2S : Advancing Fully Open-Source End-to-End Empathetic Large Speech Language Model☆89Updated 3 months ago
- [NCMMSC'2024] Emotion-Aware Prosodic Phrasing for Expressive Text-to-Speech☆22Updated last year
- ☆41Updated last year
- ☆49Updated 2 months ago
- ☆178Updated 8 months ago
- FLM-Audio is a audio-language subversion of RoboEgo/FLM-Ego -- an omnimodal model with native full duplexity.☆43Updated last month
- Code for Talk With Human-like Agents: Empathetic Dialogue Through Perceptible Acoustic Reception and Reaction (ACL24))☆46Updated last year
- Baichuan-Omni: Towards Capable Open-source Omni-modal LLM 🌊☆268Updated 9 months ago
- ☆234Updated 5 months ago
- BLSP-Emo: Towards Empathetic Large Speech-Language Models☆49Updated last year
- Towards Fine-grained Audio Captioning with Multimodal Contextual Cues☆81Updated last month
- ☆12Updated last year
- A Foundation Model for Industrial Signal Comprehensive Representation☆47Updated 2 months ago
- Code for NeurIPS 2023 paper "DASpeech: Directed Acyclic Transformer for Fast and High-quality Speech-to-Speech Translation".☆63Updated last year
- Ke-Omni-R is an advanced audio reasoning model and achieved SOTA on MMAU☆53Updated 4 months ago
- A fast speech-to-speech & speech-to-text translation model that supports simultaneous decoding and offers 28× speedup.☆76Updated last year
- EchoX: Towards Mitigating Acoustic-Semantic Gap via Echo Training for Speech-to-Speech LLMs☆40Updated last month
- a fully open-source implementation of a GPT-4o-like speech-to-speech video understanding model.☆27Updated 6 months ago
- [ACL 2024] A Multimodal, Multigenre, and Multipurpose Audio-Visual Academic Lecture Dataset☆18Updated 5 months ago
- ☆58Updated 4 months ago
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax☆15Updated last year
- PodAgent: A Comprehensive Framework for Podcast Generation☆121Updated 5 months ago