Haoqiu-Yan / PerceptiveAgentLinks
Code for Talk With Human-like Agents: Empathetic Dialogue Through Perceptible Acoustic Reception and Reaction (ACL24))
☆45Updated last year
Alternatives and similar repositories for PerceptiveAgent
Users that are interested in PerceptiveAgent are comparing it to the libraries listed below
Sorting:
- BLSP-Emo: Towards Empathetic Large Speech-Language Models☆48Updated last year
- ☆13Updated last year
- Official release of StyleTalk dataset.☆67Updated last year
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆73Updated 9 months ago
- Diff-TTSG: Denoising probabilistic integrated speech and gesture synthesis☆39Updated last year
- Make-An-Audio-3: Transforming Text/Video into Audio via Flow-based Large Diffusion Transformers☆105Updated 2 months ago
- The project page repo for Neural Dubber.☆30Updated last year
- Code for ACL 2024 main conference paper "Can We Achieve High-quality Direct Speech-to-Speech Translation Without Parallel Speech Data?".☆24Updated last year
- ☆58Updated last year
- Official Repository of IJCAI 2024 Paper: "BATON: Aligning Text-to-Audio Model with Human Preference Feedback"☆29Updated 5 months ago
- LSLM implements full duplex modeling in interactive speech language models, based on research by Ma et al. (2024). This project advances …☆74Updated last month
- Code for NeurIPS 2023 paper "DASpeech: Directed Acyclic Transformer for Fast and High-quality Speech-to-Speech Translation".☆63Updated last year
- [Interspeech 2023] Intelligible Lip-to-Speech Synthesis with Speech Units☆40Updated 9 months ago
- Towards Fine-grained Audio Captioning with Multimodal Contextual Cues☆77Updated 2 months ago
- [ACL 2024] Generative Pre-Trained Speech Language Model with Efficient Hierarchical Transformer☆60Updated 9 months ago
- Project page for "Improving Few-shot Learning for Talking Face System with TTS Data Augmentation" for ICASSP2023☆86Updated last year
- Pytorch implementation for “V2C: Visual Voice Cloning”☆32Updated 2 years ago
- Anim-400K: A dataset designed from the ground up for automated dubbing of video☆109Updated last year
- ☆53Updated last month
- OpenS2S : Advancing Fully Open-Source End-to-End Empathetic Large Speech Language Model☆66Updated 3 weeks ago
- [Interspeech 2024] SyncVSR: Data-Efficient Visual Speech Recognition with End-to-End Crossmodal Audio Token Synchronization☆56Updated 4 months ago
- ☆57Updated 2 years ago
- ☆40Updated 6 months ago
- LUCY: Linguistic Understanding and Control Yielding Early Stage of Her☆53Updated 3 months ago
- A fast speech-to-speech & speech-to-text translation model that supports simultaneous decoding and offers 28× speedup.☆75Updated 9 months ago
- Official code for "EmoVoice: LLM-based Emotional Text-To-Speech Model with Freestyle Text Prompting"☆59Updated 3 months ago
- [CVPR 2023] Official code for paper: Learning to Dub Movies via Hierarchical Prosody Models.☆108Updated last year
- ☆35Updated 3 weeks ago
- Benchmark for evaluating TTS models on complex prosodic, expressiveness, and linguistic challenges.☆128Updated last week
- An official implementation of Style-Talker for Spoken Dialogue Generation☆21Updated 6 months ago